Jul 06 13:09:46 devstack cinder-volume[75412]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 13:09:46 devstack cinder-volume[75412]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 13:09:46 devstack cinder-volume[75412]: we strongly recommend against using it for new projects.
Jul 06 13:09:46 devstack cinder-volume[75412]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 13:09:46 devstack cinder-volume[75412]: framework.  For more detail see
Jul 06 13:09:46 devstack cinder-volume[75412]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 13:09:46 devstack cinder-volume[75412]:   import eventlet  # noqa
Jul 06 13:09:48 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:09:48 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:09:48 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:09:49 devstack cinder-volume[75412]: INFO dbcounter [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Registered counter for database cinder
Jul 06 13:09:49 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writer thread running {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.rpc [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.rpc [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Determined volume DB was empty at startup.
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG cinder.volume.manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 13:09:50 devstack cinder-volume[75412]: WARNING stevedore.named [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 13:09:50 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:09:50 devstack cinder-volume[75412]: WARNING cinder.keymgr.conf_key_mgr [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG cinder.volume.drivers.lvm [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75412) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_concurrency.processutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] CMD "cinder-rtstool verify" returned: 0 in 0.382s {{(pid=75412) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.rpc [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.rpc [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 06 13:09:50 devstack cinder-volume[75412]: WARNING stevedore.named [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 13:09:50 devstack cinder-volume[75412]: WARNING castellan.key_manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO cinder.volume.manager [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_db.sqlalchemy.engines [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75412) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:09:50 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Starting 1 workers
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Started child 75628 {{(pid=75412) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Full set of CONF: {{(pid=75412) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Configuration options gathered from: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] ================================================================================ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] allow_availability_zone_fallback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] allow_compression_on_image_upload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] allowed_direct_url_schemes     = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] api_rate_limit                 = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] auth_strategy                  = keystone {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] az_cache_duration              = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_availability_zone      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_host                   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_name                   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_stats_polling_interval = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backup_api_class               = cinder.backup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backup_name_template           = backup-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backup_use_same_host           = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backup_use_temp_snapshot       = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] chap_password                  = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] chap_username                  =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_internal_tenant_project_id = 429747cc20f44d74b1c76f978c166c24 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_internal_tenant_user_id = 07b909f1c2ea443ba272068e407e3f7a {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cloned_volume_same_az          = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cluster                        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:50 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] compression_format             = gzip {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] compute_api_class              = cinder.compute.nova.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] config_dir                     = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] config_source                  = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] control_exchange               = openstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] debug                          = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] default_availability_zone      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] default_group_type             = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] default_volume_type            = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75628]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] disk_geometry                  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_client_cert             = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_client_cert_key         = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_data_namespace          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_ssl_cert_path           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_ssl_cert_verify         = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] driver_use_ssl                 = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] enable_force_upload            = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] enable_new_services            = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] enable_unsupported_driver      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] filter_function                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_api_insecure            = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_api_ssl_compression     = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_ca_certificates_file    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_catalog_info            = image:glance:publicURL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_certfile                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_keyfile                 = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_num_retries             = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance_request_timeout         = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] goodness_function              = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] graceful_shutdown_timeout      = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] group_api_class                = cinder.group.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] host                           = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack sudo[75634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_compress_on_upload       = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_conversion_address_space_limit = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_conversion_cpu_limit     = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_conversion_disable       = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack sudo[75634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_volume_cache_enabled     = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_volume_cache_max_count   = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] init_host_max_objects_retrieval = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iscsi_target_flags             =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iscsi_write_cache              = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iser_helper                    = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iser_ip_address                = 192.168.122.180 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iser_port                      = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_color                      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_config_append              = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_dir                        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_file                       = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_options                    = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_rotate_interval            = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_rotate_interval_type       = days {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] log_rotation_type              = none {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] max_age                        = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] max_logfile_count              = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] max_logfile_size_mb            = 200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] max_over_subscription_ratio    = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] message_reap_interval          = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] message_ttl                    = 2592000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] migration_create_volume_timeout_secs = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] monkey_patch                   = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] monkey_patch_modules           = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] my_ip                          = 192.168.122.180 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] no_snapshot_gb_quota           = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] num_iser_scan_tries            = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] num_shell_tries                = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] num_volume_device_scan_tries   = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] nvmeof_conn_info_version       = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] nvmet_ns_id                    = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] nvmet_port_id                  = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_max_limit                = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_ext_list          = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_listen_port       = 8776 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_use_ssl           = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] osapi_volume_workers           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] per_volume_size_limit          = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] periodic_fuzzy_delay           = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] periodic_interval              = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] public_endpoint                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] publish_errors                 = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_backup_gigabytes         = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_backups                  = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_gigabytes                = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_groups                   = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_snapshots                = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] quota_volumes                  = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] rate_limit_burst               = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] rate_limit_except_level        = CRITICAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] rate_limit_interval            = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] reinit_driver_count            = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] replication_device             = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] report_discard_supported       = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] report_interval                = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] reservation_clean_interval     = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] reservation_expire             = 86400 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] reserved_image_namespaces      = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] reserved_percentage            = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] rpc_response_timeout           = 120 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] run_external_periodic_tasks    = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] scst_target_driver             = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] scst_target_iqn_name           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_down_time              = 720 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] shell_completion               = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] snapshot_name_template         = snapshot-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] snapshot_same_host             = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] split_loggers                  = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] state_path                     = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] storage_availability_zone      = nova {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] storage_protocol               = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] syslog_log_facility            = LOG_USER {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_helper                  = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_ip_address              = 192.168.122.180 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_port                    = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_protocol                = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] target_secondary_ip_addresses  = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] trace_flags                    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] transport_url                  = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] until_refresh                  = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_chap_auth                  = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_default_quota_class        = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_journal                    = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_json                       = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_multipath_for_image_xfer   = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_stderr                     = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] use_syslog                     = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] verify_glance_signatures       = enabled {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_api_class               = cinder.volume.api.API {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_backend_name            = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_clear                   = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_clear_ionice            = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_clear_size              = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_copy_bps_limit          = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_dd_blocksize            = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_name_template           = volume-%s {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_service_inithost_offload = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volume_usage_audit_period      = month {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] zoning_mode                    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_concurrency.disable_process_locking = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.auth_type   = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.auth_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.cache       = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.certfile    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.delay_auth_decision = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.http_connect_timeout = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.include_service_catalog = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.insecure    = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.interface   = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.keyfile     = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_password =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcache_username =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.region_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.service_token_roles_required = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.service_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.token_cache_time = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.backend                  = dogpile.cache.null {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.backend_argument         = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.backend_expiration_time  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.config_prefix            = cache.oslo {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.debug_cache_backend      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.enable_retry_client      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.enable_socket_keepalive  = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.enabled                  = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.expiration_time          = 600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.hashclient_retry_attempts = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_dead_retry      = 300 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_sasl_enabled    = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.password                 = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.proxies                  = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.redis_db                 = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.redis_sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.redis_server             = localhost:6379 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.retry_attempts           = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.retry_delay              = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.socket_keepalive_count   = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.socket_keepalive_idle    = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.socket_keepalive_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.socket_timeout           = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.tls_allowed_ciphers      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.tls_cafile               = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.tls_certfile             = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.tls_enabled              = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.tls_keyfile              = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cache.username                 = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] coordination.backend_url       = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.asyncio_connection    = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.asyncio_slave_connection = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.backend               = sqlalchemy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.connection            = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.connection_debug      = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.connection_parameters =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.connection_recycle_time = 3600 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.connection_trace      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.db_inc_retry_interval = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.db_max_retries        = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.db_max_retry_interval = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.db_retry_interval     = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.075s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.max_overflow          = 50 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.max_pool_size         = 5 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.max_retries           = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.mysql_wsrep_sync_wait = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.pool_timeout          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.retry_interval        = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.slave_connection      = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.sqlite_synchronous    = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.synchronous_reader    = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] database.use_db_reconnect      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.connection_string     = messaging:// {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.enabled               = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.es_doc_type           = notification {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.es_scroll_size        = 10000 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.es_scroll_time        = 2m {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.filter_error_trace    = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.hmac_keys             = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.sentinel_service_name = mymaster {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.socket_timeout        = 0.1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.trace_requests        = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler.trace_sqlalchemy      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler_jaeger.process_tags   = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler_jaeger.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] profiler_otlp.service_name_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.enforce_new_defaults = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.enforce_scope      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.policy_default_rule = default {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.group          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] privsep_osbrick.user           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.group         = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.helper_command = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] cinder_sys_admin.user          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.auth_section      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.auth_type         = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.cafile            = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.certfile          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.collect_timing    = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.insecure          = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.keyfile           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.send_service_user_token = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.split_loggers     = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] service_user.timeout           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.auth_section            = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.auth_type               = password {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.certfile                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.collect_timing          = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.insecure                = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.keyfile                 = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.region_name             = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.split_loggers           = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] glance.timeout                 = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.chap_password = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.chap_username =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.disk_geometry = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.driver_use_ssl = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.enable_unsupported_driver = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.extra_capabilities = {} {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.filter_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.goodness_function = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iscsi_target_flags =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iscsi_write_cache = on {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iser_helper   = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iser_port     = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.lvm_share_target = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.lvm_type      = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.num_shell_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.nvmet_port_id = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.report_discard_supported = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.reserved_percentage = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.scst_target_driver = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.storage_protocol = iSCSI {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_helper = tgtadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_port   = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_protocol = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.trace_flags   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.unique_fqdn_network = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.use_chap_auth = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_backend_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_clear  = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_clear_size = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_reports.file_event_handler = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_reports.log_dir           = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.backend_availability_zone = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.backend_host       = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.chap_password      = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.chap_username      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.disk_geometry      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_client_cert = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_data_namespace = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.extra_capabilities = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.filter_function    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.goodness_function  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iser_helper        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iser_ip_address    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iser_port          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.iser_target_prefix = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.lvm_share_target   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.lvm_type           = auto {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.num_shell_tries    = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.replication_device = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.report_discard_supported = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.reserved_percentage = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.scst_target_driver = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.storage_protocol   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_helper      = lioadm {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_ip_address  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_port        = 3260 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.trace_flags        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.use_chap_auth      = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_clear       = zero {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_clear_size  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] lvmdriver-1.volumes_dir        = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_notifications.driver = [] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_notifications.retry = -1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] key_manager.fixed_key          = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.barbican_api_version  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.barbican_endpoint     = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.barbican_endpoint_type = public {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.barbican_region_name  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.cafile                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.certfile              = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.collect_timing        = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.insecure              = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.keyfile               = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.number_of_retries     = 60 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.retry_delay           = 1 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.send_service_user_token = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.split_loggers         = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.timeout               = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.verify_ssl            = True {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican.verify_ssl_path       = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.auth_section = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.auth_type = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.cafile   = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.certfile = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.collect_timing = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.insecure = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.keyfile  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.split_loggers = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] barbican_service_user.timeout  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.approle_role_id          = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.approle_secret_id        = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.kv_mountpoint            = secret {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.kv_path                  = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.kv_version               = 2 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.namespace                = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.root_token_id            = **** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.ssl_ca_crt_file          = None {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.timeout                  = 60.0 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.use_ssl                  = False {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:09:51 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] ******************************************************************************** {{(pid=75412) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 13:09:51 devstack sudo[75634]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:51 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:52 devstack sudo[75785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:09:52 devstack sudo[75785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:52 devstack sudo[75785]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:52 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.680s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:52 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:09:52 devstack cinder-volume[75628]: INFO cinder.brick.local_dev.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 06 13:09:52 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:52 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:52 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:52 devstack sudo[76002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:09:52 devstack sudo[76002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:53 devstack sudo[76002]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:53 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:53 devstack cinder-volume[75628]: DEBUG cinder.brick.local_dev.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75628) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 06 13:09:53 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:53 devstack sudo[76200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:09:53 devstack sudo[76200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:54 devstack sudo[76200]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:54 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.096s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:54 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:54 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:54 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:54 devstack sudo[76386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:09:54 devstack sudo[76386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:55 devstack sudo[76386]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:55 devstack sudo[76412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 06 13:09:55 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:55 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.697s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:55 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:55 devstack sudo[76416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:09:55 devstack sudo[76416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:56 devstack sudo[76416]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:56 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:56 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:56 devstack sudo[76421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:09:56 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:57 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:57 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.751s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:57 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:57 devstack sudo[76432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:09:57 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:58 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:58 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.796s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:58 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:58 devstack sudo[76438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:09:58 devstack sudo[76438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:09:59 devstack sudo[76438]: pam_unix(sudo:session): session closed for user root
Jul 06 13:09:59 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.947s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:59 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:59 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:09:59 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:09:59 devstack sudo[76444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:09:59 devstack sudo[76444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:00 devstack sudo[76444]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.874s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:00 devstack cinder-volume[75628]: INFO cinder.volume.drivers.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:00 devstack sudo[76458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:10:00 devstack sudo[76458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:00 devstack cinder-volume[75412]: DEBUG dbcounter [-] [75412] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75412) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:10:00 devstack sudo[76458]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.795s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:10:00 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:00 devstack sudo[76574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:10:00 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:01 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:01 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:01 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:01 devstack sudo[76715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:01 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:02 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:02 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:02 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:02 devstack sudo[76719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:10:02 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:02 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:02 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:02 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:02 devstack sudo[76722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:02 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:03 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:03 devstack cinder-volume[75628]: INFO cinder.volume.driver [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG cinder.volume.driver [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75628) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG oslo_db.sqlalchemy.engines [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75628) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writer thread running {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG cinder.db.api [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Building query based on filter {{(pid=75628) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG cinder.image.image_utils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75628) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 13:10:03 devstack cinder-volume[75628]: INFO cinder.keymgr.migration [None req-75920048-2fa0-4b3a-b142-d0ac11202cdc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:10:03 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:03 devstack sudo[76726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:10:03 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:04 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:04 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:04 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:04 devstack sudo[76734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:04 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:05 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:05 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:05 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:05 devstack sudo[76737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:10:05 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:05 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:05 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:05 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:05 devstack sudo[76741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:05 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:06 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG cinder.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Notifying Schedulers of capabilities ... {{(pid=75628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:10:06 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Driver initialization completed successfully.
Jul 06 13:10:06 devstack cinder-volume[75628]: INFO cinder.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Initiating service 2 cleanup
Jul 06 13:10:06 devstack cinder-volume[75628]: INFO cinder.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Service 2 cleanup completed.
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG cinder.service [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Creating RPC server for service cinder-volume {{(pid=75628) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG cinder.service [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75628) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 13:10:06 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:10:06 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:06 devstack sudo[76745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:10:06 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:07 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:07 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:07 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:07 devstack sudo[76748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:07 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:08 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:08 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:08 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:08 devstack sudo[76751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:10:08 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:08 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:08 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:08 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:10:08 devstack sudo[76814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:10:08 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:10:09 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root
Jul 06 13:10:09 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:10:09 devstack cinder-volume[75628]: INFO cinder.volume.manager [None req-6c410624-d561-4c71-a52d-fc6cfc64e649 None None] Driver post RPC initialization completed successfully.
Jul 06 13:10:16 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:SELECT=3 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:10:19 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:10:43 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager._thread_info {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:10:43 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread count: 6 {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:10:43 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread info: [<_MainThread(MainThread, started 139878787653760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139878680504832)>, <Thread(Thread-3 (stat_writer), started daemon 139878687836032)>, <Thread(Rabbit-heartbeat, started daemon 139878675581312)>, <Thread(Thread-5 (_runner), started daemon 139878675745216)>, <Thread(Thread-7 (_runner), started daemon 139878675811264)>] {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:11:43 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:11:43 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:11:43 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:11:43 devstack sudo[81667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:11:43 devstack sudo[81667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:11:44 devstack sudo[81667]: pam_unix(sudo:session): session closed for user root
Jul 06 13:11:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:11:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:11:44 devstack sudo[81670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:11:44 devstack sudo[81670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:11:44 devstack sudo[81670]: pam_unix(sudo:session): session closed for user root
Jul 06 13:11:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:11:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:11:44 devstack sudo[81689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:11:44 devstack sudo[81689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:11:45 devstack sudo[81689]: pam_unix(sudo:session): session closed for user root
Jul 06 13:11:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:11:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:11:45 devstack sudo[81692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:11:45 devstack sudo[81692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:11:46 devstack sudo[81692]: pam_unix(sudo:session): session closed for user root
Jul 06 13:11:46 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:11:46 devstack cinder-volume[75628]: DEBUG cinder.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Notifying Schedulers of capabilities ... {{(pid=75628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:11:46 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager._thread_info {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:11:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread count: 6 {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:11:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread info: [<_MainThread(MainThread, started 139878787653760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139878680504832)>, <Thread(Thread-3 (stat_writer), started daemon 139878687836032)>, <Thread(Rabbit-heartbeat, started daemon 139878675581312)>, <Thread(Thread-5 (_runner), started daemon 139878675745216)>, <Thread(Thread-7 (_runner), started daemon 139878675811264)>] {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:12:19 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:SELECT=1 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:12:19 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:UPDATE=1 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:12:43 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:12:43 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:12:43 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:12:43 devstack sudo[83156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:12:43 devstack sudo[83156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:12:44 devstack sudo[83156]: pam_unix(sudo:session): session closed for user root
Jul 06 13:12:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:12:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:12:44 devstack sudo[83179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:12:44 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:12:44 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root
Jul 06 13:12:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.742s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:12:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:12:44 devstack sudo[83193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:12:44 devstack sudo[83193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:12:45 devstack sudo[83193]: pam_unix(sudo:session): session closed for user root
Jul 06 13:12:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:12:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:12:45 devstack sudo[83216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:12:45 devstack sudo[83216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:12:46 devstack sudo[83216]: pam_unix(sudo:session): session closed for user root
Jul 06 13:12:46 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:12:46 devstack cinder-volume[75628]: DEBUG cinder.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Notifying Schedulers of capabilities ... {{(pid=75628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:12:46 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager._thread_info {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:12:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread count: 6 {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:12:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread info: [<_MainThread(MainThread, started 139878787653760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139878680504832)>, <Thread(Thread-3 (stat_writer), started daemon 139878687836032)>, <Thread(Rabbit-heartbeat, started daemon 139878675581312)>, <Thread(Thread-5 (_runner), started daemon 139878675745216)>, <Thread(Thread-7 (_runner), started daemon 139878675811264)>] {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:13:43 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:13:43 devstack cinder-volume[75628]: DEBUG cinder.volume.drivers.lvm [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Updating volume stats {{(pid=75628) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 13:13:43 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:13:43 devstack sudo[84639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 13:13:43 devstack sudo[84639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:13:44 devstack sudo[84639]: pam_unix(sudo:session): session closed for user root
Jul 06 13:13:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:13:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:13:44 devstack sudo[84645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:13:44 devstack sudo[84645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:13:44 devstack sudo[84645]: pam_unix(sudo:session): session closed for user root
Jul 06 13:13:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:13:44 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:13:44 devstack sudo[84656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 13:13:44 devstack sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:13:45 devstack sudo[84656]: pam_unix(sudo:session): session closed for user root
Jul 06 13:13:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:13:45 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:13:45 devstack sudo[84665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 13:13:45 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:13:46 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root
Jul 06 13:13:46 devstack cinder-volume[75628]: DEBUG oslo_concurrency.processutils [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75628) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:13:46 devstack cinder-volume[75628]: DEBUG cinder.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Notifying Schedulers of capabilities ... {{(pid=75628) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:13:46 devstack cinder-volume[75628]: DEBUG oslo_service.periodic_task [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] Running periodic task VolumeManager._thread_info {{(pid=75628) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:13:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread count: 6 {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:13:46 devstack cinder-volume[75628]: DEBUG cinder.volume.manager [None req-d25c8a75-5979-4037-b705-41fd468c4ec1 None None] thread info: [<_MainThread(MainThread, started 139878787653760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139878680504832)>, <Thread(Thread-3 (stat_writer), started daemon 139878687836032)>, <Thread(Rabbit-heartbeat, started daemon 139878675581312)>, <Thread(Thread-5 (_runner), started daemon 139878675745216)>, <Thread(Thread-7 (_runner), started daemon 139878675811264)>] {{(pid=75628) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:14:19 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:SELECT=1 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:14:19 devstack cinder-volume[75628]: DEBUG dbcounter [-] [75628] Writing DB stats cinder:UPDATE=1 {{(pid=75628) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:14:30 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Caught SIGTERM, stopping children
Jul 06 13:14:30 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Acquiring lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:30 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Acquired lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:30 devstack cinder-volume[75412]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Releasing lock "singleton_lock" {{(pid=75412) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:30 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Stop services. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 13:14:30 devstack cinder-volume[75412]: DEBUG oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Killing children. {{(pid=75412) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 13:14:30 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Waiting on 1 children to exit
Jul 06 13:14:31 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Acquiring lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:31 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Acquired lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:31 devstack cinder-volume[75628]: DEBUG oslo_concurrency.lockutils [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Releasing lock "singleton_lock" {{(pid=75628) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:31 devstack cinder-volume[75628]: WARNING amqp [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 13:14:31 devstack cinder-volume[75628]: WARNING amqp [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 13:14:31 devstack cinder-volume[75412]: INFO oslo_service.backend._eventlet.service [None req-b6691ed2-13df-4b99-9bc5-264acfca5f2b None None] Child 75628 exited with status 0
Jul 06 13:14:32 devstack cinder-volume[85709]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 13:14:32 devstack cinder-volume[85709]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 13:14:32 devstack cinder-volume[85709]: we strongly recommend against using it for new projects.
Jul 06 13:14:32 devstack cinder-volume[85709]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 13:14:32 devstack cinder-volume[85709]: framework.  For more detail see
Jul 06 13:14:32 devstack cinder-volume[85709]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 13:14:32 devstack cinder-volume[85709]:   import eventlet  # noqa
Jul 06 13:14:34 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:34 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:34 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:34 devstack cinder-volume[85709]: INFO dbcounter [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Registered counter for database cinder
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_db.sqlalchemy.engines [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG dbcounter [-] [85709] Writer thread running {{(pid=85709) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO cinder.rpc [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO cinder.rpc [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_db.sqlalchemy.engines [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO cinder.volume.manager [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Determined volume DB was empty at startup.
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG cinder.volume.manager [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85709) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO cinder.volume.manager [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 13:14:35 devstack cinder-volume[85709]: WARNING stevedore.named [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 13:14:35 devstack cinder-volume[85709]: WARNING castellan.key_manager [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:14:35 devstack cinder-volume[85709]: WARNING cinder.keymgr.conf_key_mgr [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO cinder.volume.manager [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_db.sqlalchemy.engines [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85709) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:35 devstack cinder-volume[85709]: INFO oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Starting 1 workers
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Started child 85928 {{(pid=85709) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Full set of CONF: {{(pid=85709) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] ******************************************************************************** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Configuration options gathered from: {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] ================================================================================ {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] allow_availability_zone_fallback = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] allow_compression_on_image_upload = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] allowed_direct_url_schemes     = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85928]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] api_rate_limit                 = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] auth_strategy                  = keystone {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_availability_zone      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_host                   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_name                   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_stats_polling_interval = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backup_api_class               = cinder.backup.api.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backup_name_template           = backup-%s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backup_use_same_host           = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backup_use_temp_snapshot       = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] chap_password                  = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] chap_username                  =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_internal_tenant_project_id = 429747cc20f44d74b1c76f978c166c24 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_internal_tenant_user_id = 07b909f1c2ea443ba272068e407e3f7a {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cluster                        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] compression_format             = gzip {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] compute_api_class              = cinder.compute.nova.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] config_dir                     = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] config_source                  = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] control_exchange               = openstack {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] debug                          = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] default_availability_zone      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] default_group_type             = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] default_volume_type            = QuobyteHD {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] disk_geometry                  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_client_cert             = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_client_cert_key         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_data_namespace          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_ssl_cert_path           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_ssl_cert_verify         = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] driver_use_ssl                 = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] enable_new_services            = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] enable_unsupported_driver      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] enabled_backends               = ['QuobyteHD'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] enforce_multipath_for_image_xfer = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] filter_function                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_api_insecure            = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_api_ssl_compression     = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_ca_certificates_file    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_catalog_info            = image:glance:publicURL {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_certfile                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_keyfile                 = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_num_retries             = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance_request_timeout         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] goodness_function              = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] graceful_shutdown_timeout      = 5 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] group_api_class                = cinder.group.api.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] host                           = devstack {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_compress_on_upload       = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_conversion_address_space_limit = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_conversion_cpu_limit     = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_conversion_disable       = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_upload_use_cinder_backend = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_upload_use_internal_tenant = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_volume_cache_enabled     = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_volume_cache_max_count   = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] image_volume_cache_max_size_gb = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] init_host_max_objects_retrieval = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] instance_format                = [instance: %(uuid)s]  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iscsi_target_flags             =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iscsi_write_cache              = on {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iser_helper                    = tgtadm {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iser_ip_address                = 192.168.122.180 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iser_port                      = 3260 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_color                      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_config_append              = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_dir                        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_file                       = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_options                    = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_rotate_interval            = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_rotate_interval_type       = days {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] log_rotation_type              = none {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] max_age                        = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] max_logfile_count              = 30 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] max_logfile_size_mb            = 200 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] max_over_subscription_ratio    = 20.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] message_reap_interval          = 86400 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] message_ttl                    = 2592000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] migration_create_volume_timeout_secs = 300 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] monkey_patch                   = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] monkey_patch_modules           = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] my_ip                          = 192.168.122.180 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] no_snapshot_gb_quota           = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] num_iser_scan_tries            = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] num_shell_tries                = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] num_volume_device_scan_tries   = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] nvmeof_conn_info_version       = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] nvmet_ns_id                    = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] nvmet_port_id                  = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_max_limit                = 1000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_ext_list          = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_listen_port       = 8776 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_use_ssl           = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] osapi_volume_workers           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] per_volume_size_limit          = -1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] periodic_fuzzy_delay           = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] periodic_interval              = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] public_endpoint                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] publish_errors                 = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_backup_gigabytes         = 1000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_backups                  = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_gigabytes                = 1000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_groups                   = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_snapshots                = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] quota_volumes                  = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] rate_limit_burst               = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] rate_limit_except_level        = CRITICAL {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] rate_limit_interval            = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] reinit_driver_count            = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] replication_device             = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] report_discard_supported       = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] report_interval                = 120 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] reservation_clean_interval     = 86400 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] reservation_expire             = 86400 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] reserved_image_namespaces      = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] reserved_percentage            = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] rpc_response_timeout           = 120 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] run_external_periodic_tasks    = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] scst_target_driver             = iscsi {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] scst_target_iqn_name           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_down_time              = 720 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] shell_completion               = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85928]: INFO cinder.volume.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.remotefs [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85928) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] snapshot_name_template         = snapshot-%s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] split_loggers                  = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] state_path                     = /opt/stack/data/cinder {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] storage_availability_zone      = nova {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] storage_protocol               = iSCSI {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] syslog_log_facility            = LOG_USER {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_helper                  = lioadm {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_ip_address              = 192.168.122.180 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_port                    = 3260 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_protocol                = iscsi {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] target_secondary_ip_addresses  = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] trace_flags                    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] transport_url                  = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] until_refresh                  = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_chap_auth                  = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_default_quota_class        = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_journal                    = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_json                       = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_multipath_for_image_xfer   = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_stderr                     = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] use_syslog                     = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] verify_glance_signatures       = enabled {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_api_class               = cinder.volume.api.API {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_backend_name            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_clear                   = zero {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_clear_ionice            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_clear_size              = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_copy_bps_limit          = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_dd_blocksize            = 1M {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_name_template           = volume-%s {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_service_inithost_offload = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volume_usage_audit_period      = month {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] zoning_mode                    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_concurrency.disable_process_locking = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.auth_section = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.auth_type   = password {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.auth_version = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.cache       = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.certfile    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.include_service_catalog = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.insecure    = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.interface   = public {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.keyfile     = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_password =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcache_username =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.region_name = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.service_type = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.backend                  = dogpile.cache.null {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.backend_argument         = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.backend_expiration_time  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.config_prefix            = cache.oslo {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.debug_cache_backend      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.enable_retry_client      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.enable_socket_keepalive  = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.enabled                  = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.expiration_time          = 600 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.hashclient_retry_attempts = 2 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_dead_retry      = 300 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_pool_maxsize    = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_sasl_enabled    = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.password                 = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.proxies                  = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.redis_db                 = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.redis_server             = localhost:6379 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.retry_attempts           = 2 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.retry_delay              = 0.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.socket_keepalive_count   = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.socket_keepalive_idle    = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.socket_keepalive_interval = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.socket_timeout           = 1.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.tls_allowed_ciphers      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.tls_cafile               = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.tls_certfile             = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.tls_enabled              = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.tls_keyfile              = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cache.username                 = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] coordination.backend_url       = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.asyncio_connection    = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.asyncio_slave_connection = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.backend               = sqlalchemy {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.connection            = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.connection_debug      = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.connection_parameters =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.connection_recycle_time = 3600 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.connection_trace      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.db_inc_retry_interval = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.db_max_retries        = 20 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.db_max_retry_interval = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.db_retry_interval     = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.max_overflow          = 50 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.max_pool_size         = 5 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.max_retries           = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.mysql_wsrep_sync_wait = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.pool_timeout          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85928) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.retry_interval        = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: WARNING cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 13:14:35 devstack cinder-volume[85928]: WARNING cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.slave_connection      = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.sqlite_synchronous    = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Running cmd (subprocess): mount.quobyte {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.synchronous_reader    = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] database.use_db_reconnect      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.connection_string     = messaging:// {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.enabled               = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.es_doc_type           = notification {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.es_scroll_size        = 10000 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.es_scroll_time        = 2m {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.filter_error_trace    = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.hmac_keys             = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.sentinel_service_name = mymaster {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.socket_timeout        = 0.1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.trace_requests        = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler.trace_sqlalchemy      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler_jaeger.process_tags   = {} {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler_jaeger.service_name_prefix = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] profiler_otlp.service_name_prefix = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.enforce_new_defaults = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.enforce_scope      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.policy_default_rule = default {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.policy_file        = policy.yaml {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.group          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.helper_command = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] privsep_osbrick.user           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.group         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.helper_command = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] cinder_sys_admin.user          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.auth_section      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.auth_type         = password {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.cafile            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.certfile          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.collect_timing    = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.insecure          = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.keyfile           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.send_service_user_token = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.split_loggers     = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] service_user.timeout           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.auth_section            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.auth_type               = password {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.certfile                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.collect_timing          = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.insecure                = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.keyfile                 = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.region_name             = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.split_loggers           = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] glance.timeout                 = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.backend_availability_zone = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.chap_password = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.chap_username =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.disk_geometry = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_client_cert = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_client_cert_key = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_data_namespace = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.driver_use_ssl = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.extra_capabilities = {} {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.filter_function = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.goodness_function = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iscsi_target_flags =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iscsi_write_cache = on {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iser_helper   = tgtadm {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iser_port     = 3260 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_host      =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_login     = admin {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_mount_options = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack quobyte-client[85933]: Reading configuration file: /etc/quobyte/client.cfg
Jul 06 13:14:35 devstack quobyte-client[85933]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_password  = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_private_key =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_share_path =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=85928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:35 devstack cinder-volume[85928]: INFO cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 ...
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b -c /etc/quobyte/client-cinder.cfg {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.num_shell_tries = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.quobyte_volume_url = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.replication_device = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.report_discard_supported = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.reserved_percentage = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_helper = tgtadm {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_port   = 3260 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_protocol = iscsi {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.trace_flags   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.unique_fqdn_network = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.use_chap_auth = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_backend_name = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_clear  = zero {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_clear_ionice = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_clear_size = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_reports.file_event_handler = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_reports.log_dir           = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.backend_availability_zone = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.backend_host         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.chap_password        = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.chap_username        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.chiscsi_conf         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.disk_geometry        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack sudo[85934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b -c /etc/quobyte/client-cinder.cfg
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_client_cert   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_data_namespace = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.driver_use_ssl       = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack sudo[85934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.extra_capabilities   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.filter_function      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.goodness_function    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iser_helper          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iser_ip_address      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iser_port            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.iser_target_prefix   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_host             = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_login            = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:35 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_mount_options    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_password         = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_private_key      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_share_path       = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_ssh_port         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.num_shell_tries      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.nvmet_port_id        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.replication_device   = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.report_discard_supported = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.reserved_percentage  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.scst_target_driver   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.storage_protocol     = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_helper        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_ip_address    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_port          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_prefix        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_protocol      = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.trace_flags          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.use_chap_auth        = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_clear         = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_clear_size    = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] QuobyteHD.volumes_dir          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl      = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_notifications.driver = [] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_notifications.retry = -1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] key_manager.fixed_key          = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.barbican_api_version  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.barbican_endpoint     = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.barbican_endpoint_type = public {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.barbican_region_name  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.cafile                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.certfile              = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.collect_timing        = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.insecure              = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.keyfile               = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.number_of_retries     = 60 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.retry_delay           = 1 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.send_service_user_token = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.split_loggers         = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.timeout               = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.verify_ssl            = True {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican.verify_ssl_path       = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.auth_section = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.auth_type = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.cafile   = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.certfile = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.collect_timing = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.insecure = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.keyfile  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.split_loggers = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] barbican_service_user.timeout  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.approle_role_id          = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.approle_secret_id        = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.kv_mountpoint            = secret {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.kv_path                  = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.kv_version               = 2 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.namespace                = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.root_token_id            = **** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.ssl_ca_crt_file          = None {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.timeout                  = 60.0 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.use_ssl                  = False {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:36 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] ******************************************************************************** {{(pid=85709) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 13:14:36 devstack sudo[85934]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:36 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.027s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:36 devstack cinder-volume[85928]: INFO cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 succeeded
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=85928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.047s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:37 devstack sudo[86028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:37 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:37 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.780s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:37 devstack cinder-volume[85928]: INFO cinder.volume.driver [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.volume.driver [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7531204223633, 'free_capacity_gb': 1775.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85928) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_db.sqlalchemy.engines [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG dbcounter [-] [85928] Writer thread running {{(pid=85928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.db.api [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Building query based on filter {{(pid=85928) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.image.image_utils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85928) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 13:14:37 devstack cinder-volume[85928]: INFO cinder.keymgr.migration [None req-9b22fc43-a5f3-422f-ae23-5de2774342b5 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=85928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=85928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:37 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:37 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:37 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:38 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.717s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG cinder.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Notifying Schedulers of capabilities ... {{(pid=85928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:14:38 devstack cinder-volume[85928]: INFO cinder.volume.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Driver initialization completed successfully.
Jul 06 13:14:38 devstack cinder-volume[85928]: INFO cinder.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Initiating service 3 cleanup
Jul 06 13:14:38 devstack cinder-volume[85928]: INFO cinder.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Service 3 cleanup completed.
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG cinder.service [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Creating RPC server for service cinder-volume {{(pid=85928) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG cinder.service [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85928) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 13:14:38 devstack cinder-volume[85928]: INFO cinder.volume.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=85928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=85928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:38 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:38 devstack sudo[86065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:38 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:39 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.005s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:39 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:40 devstack cinder-volume[85928]: INFO cinder.volume.manager [None req-53606d5a-571a-4c28-aad9-66fb0c9a0430 None None] Driver post RPC initialization completed successfully.
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=85928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG cinder.volume.drivers.quobyte [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=85928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85928) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:43 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:43 devstack sudo[86249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:43 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:44 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:44 devstack cinder-volume[85928]: DEBUG oslo_concurrency.processutils [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.624s {{(pid=85928) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:44 devstack cinder-volume[85928]: DEBUG cinder.manager [None req-a0b2adbe-63c7-4ce7-ae19-ca9e6dbf3b8d None None] Notifying Schedulers of capabilities ... {{(pid=85928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:14:45 devstack cinder-volume[85709]: INFO oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Caught SIGTERM, stopping children
Jul 06 13:14:45 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Acquiring lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:45 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Acquired lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:45 devstack cinder-volume[85709]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Releasing lock "singleton_lock" {{(pid=85709) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:45 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Stop services. {{(pid=85709) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 13:14:45 devstack cinder-volume[85709]: DEBUG oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Killing children. {{(pid=85709) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 13:14:45 devstack cinder-volume[85709]: INFO oslo_service.backend._eventlet.service [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Waiting on 1 children to exit
Jul 06 13:14:48 devstack cinder-volume[85928]: DEBUG dbcounter [-] [85928] Writing DB stats cinder:SELECT=2 {{(pid=85928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:14:49 devstack cinder-volume[85928]: DEBUG dbcounter [-] [85928] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85928) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:14:50 devstack cinder-volume[85928]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 06 13:14:51 devstack cinder-volume[86421]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 13:14:51 devstack cinder-volume[86421]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 13:14:51 devstack cinder-volume[86421]: we strongly recommend against using it for new projects.
Jul 06 13:14:51 devstack cinder-volume[86421]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 13:14:51 devstack cinder-volume[86421]: framework.  For more detail see
Jul 06 13:14:51 devstack cinder-volume[86421]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 13:14:51 devstack cinder-volume[86421]:   import eventlet  # noqa
Jul 06 13:14:52 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Acquiring lock "singleton_lock" {{(pid=85928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:52 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Acquired lock "singleton_lock" {{(pid=85928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:52 devstack cinder-volume[85928]: DEBUG oslo_concurrency.lockutils [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Releasing lock "singleton_lock" {{(pid=85928) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:52 devstack cinder-volume[85928]: WARNING amqp [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 13:14:52 devstack cinder-volume[85928]: WARNING amqp [None req-df92b025-1c04-4f62-bf5e-33814c5c1b7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 13:14:53 devstack cinder-volume[86421]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 13:14:53 devstack cinder-volume[86421]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 13:14:53 devstack cinder-volume[86421]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86421) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO dbcounter [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Registered counter for database cinder
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_db.sqlalchemy.engines [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG dbcounter [-] [86421] Writer thread running {{(pid=86421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO cinder.rpc [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO cinder.rpc [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_db.sqlalchemy.engines [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO cinder.volume.manager [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Determined volume DB was empty at startup.
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG cinder.volume.manager [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86421) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 13:14:54 devstack cinder-volume[86421]: WARNING stevedore.named [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 13:14:54 devstack cinder-volume[86421]: WARNING castellan.key_manager [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:14:54 devstack cinder-volume[86421]: WARNING cinder.keymgr.conf_key_mgr [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO cinder.volume.manager [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_db.sqlalchemy.engines [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86421) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:54 devstack cinder-volume[86421]: INFO oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Starting 1 workers
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Started child 86698 {{(pid=86421) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Full set of CONF: {{(pid=86421) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] ******************************************************************************** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] Configuration options gathered from: {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] ================================================================================ {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] allow_availability_zone_fallback = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86698]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] allow_compression_on_image_upload = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] allowed_direct_url_schemes     = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] api_rate_limit                 = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] auth_strategy                  = keystone {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_availability_zone      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_host                   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_name                   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_stats_polling_interval = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backup_api_class               = cinder.backup.api.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backup_name_template           = backup-%s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backup_use_same_host           = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backup_use_temp_snapshot       = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] chap_password                  = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] chap_username                  =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_internal_tenant_project_id = 429747cc20f44d74b1c76f978c166c24 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_internal_tenant_user_id = 07b909f1c2ea443ba272068e407e3f7a {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cluster                        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] compression_format             = gzip {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] compute_api_class              = cinder.compute.nova.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] config_dir                     = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] config_source                  = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] control_exchange               = openstack {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] debug                          = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] default_availability_zone      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] default_group_type             = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] default_volume_type            = QuobyteHD {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] disk_geometry                  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_client_cert             = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_client_cert_key         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_data_namespace          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_ssl_cert_path           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_ssl_cert_verify         = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] driver_use_ssl                 = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] enable_new_services            = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] enable_unsupported_driver      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] enabled_backends               = ['QuobyteHD'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] enforce_multipath_for_image_xfer = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:54 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] filter_function                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_api_insecure            = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_api_servers             = ['http://192.168.122.180/image'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_api_ssl_compression     = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_ca_certificates_file    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_catalog_info            = image:glance:publicURL {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_certfile                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_keyfile                 = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_num_retries             = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance_request_timeout         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] goodness_function              = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] graceful_shutdown_timeout      = 5 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] group_api_class                = cinder.group.api.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] host                           = devstack {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_compress_on_upload       = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_conversion_address_space_limit = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_conversion_cpu_limit     = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_conversion_disable       = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_upload_use_cinder_backend = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_upload_use_internal_tenant = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_volume_cache_enabled     = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_volume_cache_max_count   = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] image_volume_cache_max_size_gb = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] init_host_max_objects_retrieval = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] instance_format                = [instance: %(uuid)s]  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iscsi_target_flags             =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iscsi_write_cache              = on {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iser_helper                    = tgtadm {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iser_ip_address                = 192.168.122.180 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iser_port                      = 3260 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_color                      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_config_append              = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86698) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_dir                        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_file                       = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_options                    = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_rotate_interval            = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_rotate_interval_type       = days {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] log_rotation_type              = none {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] max_age                        = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] max_logfile_count              = 30 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] max_logfile_size_mb            = 200 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] max_over_subscription_ratio    = 20.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] message_reap_interval          = 86400 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] message_ttl                    = 2592000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] migration_create_volume_timeout_secs = 300 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] monkey_patch                   = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] monkey_patch_modules           = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] my_ip                          = 192.168.122.180 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] no_snapshot_gb_quota           = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] num_iser_scan_tries            = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] num_shell_tries                = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] num_volume_device_scan_tries   = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] nvmeof_conn_info_version       = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] nvmet_ns_id                    = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] nvmet_port_id                  = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_max_limit                = 1000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_ext_list          = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_listen_port       = 8776 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_use_ssl           = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] osapi_volume_workers           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] per_volume_size_limit          = -1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] periodic_fuzzy_delay           = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] periodic_interval              = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] public_endpoint                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] publish_errors                 = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_backup_gigabytes         = 1000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_backups                  = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_gigabytes                = 1000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_groups                   = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_snapshots                = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] quota_volumes                  = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] rate_limit_burst               = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] rate_limit_except_level        = CRITICAL {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] rate_limit_interval            = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] reinit_driver_count            = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] replication_device             = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] report_discard_supported       = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] report_interval                = 120 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] reservation_clean_interval     = 86400 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] reservation_expire             = 86400 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] reserved_image_namespaces      = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] reserved_percentage            = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] rpc_response_timeout           = 120 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] run_external_periodic_tasks    = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] scst_target_driver             = iscsi {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] scst_target_iqn_name           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_down_time              = 720 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] shell_completion               = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] snapshot_name_template         = snapshot-%s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] split_loggers                  = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] state_path                     = /opt/stack/data/cinder {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] storage_availability_zone      = nova {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] storage_protocol               = iSCSI {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] syslog_log_facility            = LOG_USER {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_helper                  = lioadm {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_ip_address              = 192.168.122.180 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_port                    = 3260 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_protocol                = iscsi {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] target_secondary_ip_addresses  = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] trace_flags                    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] transport_url                  = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] until_refresh                  = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_chap_auth                  = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_default_quota_class        = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_journal                    = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_json                       = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_multipath_for_image_xfer   = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_stderr                     = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] use_syslog                     = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] verify_glance_signatures       = enabled {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_api_class               = cinder.volume.api.API {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_backend_name            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_clear                   = zero {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_clear_ionice            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_clear_size              = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_copy_bps_limit          = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_dd_blocksize            = 1M {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_name_template           = volume-%s {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_service_inithost_offload = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volume_usage_audit_period      = month {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] zoning_mode                    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_concurrency.disable_process_locking = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.auth_section = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.auth_type   = password {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.auth_version = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.cache       = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.certfile    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.include_service_catalog = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.insecure    = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.interface   = public {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.keyfile     = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_password =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcache_username =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.region_name = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.service_type = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.180/identity {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.backend                  = dogpile.cache.null {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.backend_argument         = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.backend_expiration_time  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.config_prefix            = cache.oslo {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.debug_cache_backend      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.enable_retry_client      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.enable_socket_keepalive  = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.enabled                  = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.expiration_time          = 600 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.hashclient_retry_attempts = 2 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_dead_retry      = 300 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_pool_maxsize    = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_sasl_enabled    = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.password                 = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.proxies                  = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.redis_db                 = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.redis_server             = localhost:6379 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.retry_attempts           = 2 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.retry_delay              = 0.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.socket_keepalive_count   = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.socket_keepalive_idle    = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.socket_keepalive_interval = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.socket_timeout           = 1.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.tls_allowed_ciphers      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.tls_cafile               = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.tls_certfile             = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.tls_enabled              = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.tls_keyfile              = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cache.username                 = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] coordination.backend_url       = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.asyncio_connection    = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.asyncio_slave_connection = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.backend               = sqlalchemy {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.connection            = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.connection_debug      = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.connection_parameters =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.connection_recycle_time = 3600 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.connection_trace      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.db_inc_retry_interval = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.db_max_retries        = 20 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.db_max_retry_interval = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.db_retry_interval     = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.max_overflow          = 50 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.max_pool_size         = 5 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.max_retries           = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.mysql_wsrep_sync_wait = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.pool_timeout          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.retry_interval        = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.slave_connection      = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86698) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 13:14:55 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.sqlite_synchronous    = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.synchronous_reader    = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] database.use_db_reconnect      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Running cmd (subprocess): mount.quobyte {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.connection_string     = messaging:// {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.enabled               = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.es_doc_type           = notification {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.es_scroll_size        = 10000 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.es_scroll_time        = 2m {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.filter_error_trace    = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.hmac_keys             = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.sentinel_service_name = mymaster {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.socket_timeout        = 0.1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.trace_requests        = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler.trace_sqlalchemy      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler_jaeger.process_tags   = {} {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler_jaeger.service_name_prefix = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] profiler_otlp.service_name_prefix = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.enforce_new_defaults = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.enforce_scope      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.policy_default_rule = default {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.policy_file        = policy.yaml {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.group          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.helper_command = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] privsep_osbrick.user           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.group         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.helper_command = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] cinder_sys_admin.user          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.auth_section      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.auth_type         = password {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.cafile            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.certfile          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.collect_timing    = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.insecure          = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.keyfile           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.send_service_user_token = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.split_loggers     = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] service_user.timeout           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.auth_section            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.auth_type               = password {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.certfile                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.collect_timing          = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.insecure                = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.keyfile                 = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.region_name             = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.split_loggers           = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] glance.timeout                 = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.backend_availability_zone = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.chap_password = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.chap_username =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.disk_geometry = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_client_cert = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_client_cert_key = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_data_namespace = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.driver_use_ssl = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.extra_capabilities = {} {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.filter_function = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.goodness_function = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iscsi_target_flags =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iscsi_write_cache = on {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iser_helper   = tgtadm {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iser_ip_address = 192.168.122.180 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iser_port     = 3260 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_host      =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_login     = admin {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_mount_options = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_password  = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_private_key =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_share_path =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.num_shell_tries = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.quobyte_volume_url = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.replication_device = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.report_discard_supported = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.reserved_percentage = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_helper = tgtadm {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_ip_address = 192.168.122.180 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_port   = 3260 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_protocol = iscsi {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.trace_flags   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.unique_fqdn_network = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.use_chap_auth = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_backend_name = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_clear  = zero {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_clear_ionice = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_clear_size = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_reports.file_event_handler = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_reports.log_dir           = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.backend_availability_zone = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.backend_host         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.chap_password        = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.chap_username        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.chiscsi_conf         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.disk_geometry        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_client_cert   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_data_namespace = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.driver_use_ssl       = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack quobyte-client[86699]: Reading configuration file: /etc/quobyte/client.cfg
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.extra_capabilities   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.filter_function      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack quobyte-client[86699]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.goodness_function    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iser_helper          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iser_ip_address      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iser_port            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.iser_target_prefix   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_host             = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_login            = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_mount_options    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_password         = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_private_key      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_share_path       = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_ssh_port         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.num_shell_tries      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.nvmet_port_id        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.replication_device   = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.report_discard_supported = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.reserved_percentage  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.scst_target_driver   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.storage_protocol     = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_helper        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_ip_address    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_port          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_prefix        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_protocol      = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.trace_flags          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.use_chap_auth        = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_clear         = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_clear_size    = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] QuobyteHD.volumes_dir          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl      = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_notifications.driver = [] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_notifications.retry = -1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] key_manager.fixed_key          = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.barbican_api_version  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.barbican_endpoint     = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.barbican_endpoint_type = public {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.barbican_region_name  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.cafile                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack sudo[86702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.certfile              = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.collect_timing        = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.insecure              = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.keyfile               = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.number_of_retries     = 60 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.retry_delay           = 1 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.send_service_user_token = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.split_loggers         = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.timeout               = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.verify_ssl            = True {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican.verify_ssl_path       = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.auth_section = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.auth_type = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.cafile   = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.certfile = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.collect_timing = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.insecure = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.keyfile  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.split_loggers = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] barbican_service_user.timeout  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.approle_role_id          = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.approle_secret_id        = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.kv_mountpoint            = secret {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.kv_path                  = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.kv_version               = 2 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.namespace                = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.root_token_id            = **** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.ssl_ca_crt_file          = None {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.timeout                  = 60.0 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.use_ssl                  = False {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 13:14:55 devstack cinder-volume[86421]: DEBUG oslo_service.backend._eventlet.service [None req-f05d223b-4797-44cb-97d7-a0d79bb6a89a None None] ******************************************************************************** {{(pid=86421) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 13:14:55 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:55 devstack cinder-volume[86698]: INFO cinder.volume.driver [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.driver [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7531204223633, 'free_capacity_gb': 1775.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86698) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_db.sqlalchemy.engines [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writer thread running {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.db.api [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Building query based on filter {{(pid=86698) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86698) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:55 devstack cinder-volume[86698]: INFO cinder.keymgr.migration [None req-f659273b-28ed-4d17-92b6-0ba2fb0d9c58 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 13:14:55 devstack sudo[86708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:55 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:56 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.624s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:14:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Driver initialization completed successfully.
Jul 06 13:14:56 devstack cinder-volume[86698]: INFO cinder.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Initiating service 3 cleanup
Jul 06 13:14:56 devstack cinder-volume[86698]: INFO cinder.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Service 3 cleanup completed.
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG cinder.service [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Creating RPC server for service cinder-volume {{(pid=86698) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG cinder.service [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86698) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 13:14:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:14:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:14:56 devstack sudo[86714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:14:56 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:14:57 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root
Jul 06 13:14:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.643s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:14:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-678df84d-61d2-47e3-999d-3333692a6858 None None] Driver post RPC initialization completed successfully.
Jul 06 13:15:04 devstack cinder-volume[86421]: DEBUG dbcounter [-] [86421] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86421) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:15:06 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:15:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=2 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:15:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:15:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 6 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:15:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:15:53 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Flow 'volume_create_manager' (19b13a56-101c-4f43-bb34-1afce2053e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8824f8bf-e327-4f49-8af4-9a23342283fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8824f8bf-e327-4f49-8af4-9a23342283fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-267564804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790895f6-87f5-461d-b681-54b9de048321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb8d912da524912b310db9744d9f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:15:54Z,use_quota=True,user_id='247d350e20bf4a178be4a616cfa5c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19eee3e-ec04-48e7-b6a0-d5dc16054a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19eee3e-ec04-48e7-b6a0-d5dc16054a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e916a8f1-5e39-4f58-b95d-5a071a8733a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e916a8f1-5e39-4f58-b95d-5a071a8733a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790895f6-87f5-461d-b681-54b9de048321', 'volume_name': 'volume-790895f6-87f5-461d-b681-54b9de048321', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf27b471-5699-42d7-bf59-d5df0223b00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf27b471-5699-42d7-bf59-d5df0223b00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6b79a3-ef1b-475c-b9c3-7283449de391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Volume 790895f6-87f5-461d-b681-54b9de048321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790895f6-87f5-461d-b681-54b9de048321', 'volume_size': 1}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-267564804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790895f6-87f5-461d-b681-54b9de048321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb8d912da524912b310db9744d9f06b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:15:54Z,use_quota=True,user_id='247d350e20bf4a178be4a616cfa5c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Creating volume 790895f6-87f5-461d-b681-54b9de048321 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:15:54 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:15:54 devstack sudo[87216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 1073741824
Jul 06 13:15:54 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Flow 'volume_create_manager' (0d8c9c1f-c10b-4086-9041-5e044740e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d10618-94a6-4fad-9305-bdff0e2f816f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d10618-94a6-4fad-9305-bdff0e2f816f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1103839391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f354ed7a-2f9b-43d2-babf-c32b5cabdaa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4503fd00b7ec4a118b071784ecd12cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:15:54Z,use_quota=True,user_id='f0add0e690d945178c77af78bd0c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df1b970-3b5f-423c-a9d0-94a534adc502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df1b970-3b5f-423c-a9d0-94a534adc502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cade9af-5300-4719-ac76-1bea70fd5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cade9af-5300-4719-ac76-1bea70fd5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f354ed7a-2f9b-43d2-babf-c32b5cabdaa7', 'volume_name': 'volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b12352-27ef-46c3-b385-af3e10372bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53b12352-27ef-46c3-b385-af3e10372bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6980612-2f83-4258-bf39-12c0eb02b290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:54 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Volume f354ed7a-2f9b-43d2-babf-c32b5cabdaa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7', 'volume_size': 1}
Jul 06 13:15:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:15:56 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root
Jul 06 13:15:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 1073741824" returned: 0 in 2.419s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:15:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:15:57 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321
Jul 06 13:15:57 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:15:58 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321" returned: 0 in 1.683s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] <== create_volume: return (4245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.259s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.806s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1103839391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f354ed7a-2f9b-43d2-babf-c32b5cabdaa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4503fd00b7ec4a118b071784ecd12cb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:15:54Z,use_quota=True,user_id='f0add0e690d945178c77af78bd0c0981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Creating volume f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:15:58 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:15:58 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 1073741824
Jul 06 13:15:58 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6b79a3-ef1b-475c-b9c3-7283449de391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790895f6-87f5-461d-b681-54b9de048321', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d10a6-cfac-4693-a318-3ad3861ae3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:15:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Volume volume-790895f6-87f5-461d-b681-54b9de048321 (790895f6-87f5-461d-b681-54b9de048321): created successfully
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f7d10a6-cfac-4693-a318-3ad3861ae3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:15:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Flow 'volume_create_manager' (19b13a56-101c-4f43-bb34-1afce2053e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:15:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e028c9d2-6db4-4e4e-9b64-cf89d1949396 tempest-DeleteServersTestJSON-23064254 None] Created volume successfully.
Jul 06 13:16:00 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 1073741824" returned: 0 in 1.392s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:00 devstack sudo[87556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7
Jul 06 13:16:00 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:01 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" returned: 0 in 0.850s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.330s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6980612-2f83-4258-bf39-12c0eb02b290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed9d36c-b8a2-4530-830d-0cf155a826b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Volume volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 (f354ed7a-2f9b-43d2-babf-c32b5cabdaa7): created successfully
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed9d36c-b8a2-4530-830d-0cf155a826b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Flow 'volume_create_manager' (0d8c9c1f-c10b-4086-9041-5e044740e20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:16:01 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-47e5d249-f14d-4e60-a085-2a994dc88120 req-db7dd263-4ba5-4c48-8905-2813bfd1f9f0 tempest-VolumesGetTestJSON-1481188710 None] Created volume successfully.
Jul 06 13:16:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Acquiring lock "cinder-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "cinder-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Acquiring lock "cinder-quobyte-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "cinder-quobyte-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:02 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3ppbl1qo/privsep.sock']
Jul 06 13:16:02 devstack sudo[87575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3ppbl1qo/privsep.sock
Jul 06 13:16:02 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 13:16:03 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 13:16:04 devstack cinder-volume[86698]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 06 13:16:05 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:05 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Spawned new privsep daemon via rootwrap
Jul 06 13:16:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Accepted privsep connection to /tmp/tmp3ppbl1qo/privsep.sock {{(pid=86698) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 06 13:16:05 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 06 13:16:05 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 06 13:16:05 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 06 13:16:05 devstack cinder-volume[86698]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87595
Jul 06 13:16:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[45968a34-9197-4614-a1af-72a840123697]: (2,) {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602c869-2c63-42ed-9134-460b8005c5a4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:05 devstack sudo[87598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7
Jul 06 13:16:05 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:06 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" returned: 0 in 1.042s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:06 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7
Jul 06 13:16:06 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:06 devstack cinder-volume[86698]: WARNING py.warnings [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 06 13:16:06 devstack cinder-volume[86698]:   .first()
Jul 06 13:16:06 devstack cinder-volume[86698]: 
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1f53d-e274-41d2-80f6-4db7117c4f09]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:06 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321
Jul 06 13:16:06 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:07 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" returned: 0 in 0.872s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "cinder-quobyte-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7" released by "delete_volume" :: held 4.447s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:07 devstack cinder-volume[86698]: WARNING cinder.quota [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:16:07 devstack cinder-volume[86698]: WARNING cinder.quota [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG cinder.quota [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Created reservations ['38ff581e-8cf7-4278-bfad-30a09fc92229', '8ef5e2da-c6fa-4fda-a328-c5116826265f', 'a5ea074c-c862-4b88-ba6c-956385ea49d4', 'ac6ea36e-7779-4c10-a1b2-3e3b931a8906'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:07 devstack sudo[87650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:16:07 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:07 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321" returned: 0 in 1.033s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.051s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-790895f6-87f5-461d-b681-54b9de048321', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a971831a-fe96-47fc-8c27-73348d54e9d1', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:16:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-2389ab7a-62e2-4c24-aa49-cfb99a735f08 req-3c894954-1a16-43c7-9848-04a0384a51ab tempest-DeleteServersTestJSON-23064254 None] attachment_update completed successfully.
Jul 06 13:16:08 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.827s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:08 devstack cinder-volume[86698]: DEBUG cinder.manager [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:16:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Deleted volume successfully.
Jul 06 13:16:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-edbbde15-a14a-454e-bd63-217ce074d17e req-3c8c0cec-d443-4a85-99f8-78126c6fefc4 tempest-VolumesGetTestJSON-1481188710 None] Lock "cinder-f354ed7a-2f9b-43d2-babf-c32b5cabdaa7-delete_volume" released by "delete_volume" :: held 5.662s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-813828aa-b077-4c70-8eff-209d984a1d86 tempest-GroupSnapshotsV319Test-1104413497 None] Group tempest-GroupSnapshotsV319Test-Group-237982789: creating
Jul 06 13:16:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-813828aa-b077-4c70-8eff-209d984a1d86 tempest-GroupSnapshotsV319Test-1104413497 None] Group tempest-GroupSnapshotsV319Test-Group-237982789: created successfully
Jul 06 13:16:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-813828aa-b077-4c70-8eff-209d984a1d86 tempest-GroupSnapshotsV319Test-1104413497 None] Create group completed successfully.
Jul 06 13:16:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-dc44ce5d-1da7-4429-916f-5fb568a624d0 req-77f9b045-8635-45e3-b507-700062fcba38 tempest-DeleteServersTestJSON-23064254 None] Terminate volume connection completed successfully.
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-dc44ce5d-1da7-4429-916f-5fb568a624d0 req-77f9b045-8635-45e3-b507-700062fcba38 tempest-DeleteServersTestJSON-23064254 None] Deleting attachment a971831a-fe96-47fc-8c27-73348d54e9d1. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:18 devstack sudo[88110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:16:18 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:19 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.794s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:16:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:16:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 8 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:16:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Flow 'volume_create_manager' (3b5094e6-6e2e-40b0-98d0-f5e95eba8562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b153c74-3ee9-4da8-95ab-280650fe3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b153c74-3ee9-4da8-95ab-280650fe3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29534027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85db45e5-362c-4fd2-ba2c-be2facf1c1c0,host='devstack@QuobyteHD#QuobyteHD',id=d2d10746-84a0-4c78-999e-49044e25bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b35ec37bf2428dbba53d6b8b6f70bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:16:20Z,use_quota=True,user_id='d43d57a1218e46ea966b644d36e26d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea2141b8-a187-4e4b-9272-a597b409523a),volume_type_id=ea2141b8-a187-4e4b-9272-a597b409523a)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecd5f5d-7b05-4ccc-ba09-410014a1f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecd5f5d-7b05-4ccc-ba09-410014a1f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e8aa87-9a47-4874-a251-c6cc79560869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e8aa87-9a47-4874-a251-c6cc79560869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d10746-84a0-4c78-999e-49044e25bfee', 'volume_name': 'volume-d2d10746-84a0-4c78-999e-49044e25bfee', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8a123-088a-4ad1-b38b-d9608179ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8a123-088a-4ad1-b38b-d9608179ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a860ccc-8cb6-4dcb-9836-17080d8207ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Volume d2d10746-84a0-4c78-999e-49044e25bfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d10746-84a0-4c78-999e-49044e25bfee', 'volume_size': 1}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=85db45e5-362c-4fd2-ba2c-be2facf1c1c0,created_at=2026-07-06T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29534027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=85db45e5-362c-4fd2-ba2c-be2facf1c1c0,host='devstack@QuobyteHD#QuobyteHD',id=d2d10746-84a0-4c78-999e-49044e25bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b35ec37bf2428dbba53d6b8b6f70bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:16:20Z,use_quota=True,user_id='d43d57a1218e46ea966b644d36e26d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea2141b8-a187-4e4b-9272-a597b409523a),volume_type_id=ea2141b8-a187-4e4b-9272-a597b409523a)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Creating volume d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:16:20 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:20 devstack sudo[88116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee 1073741824
Jul 06 13:16:20 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Flow 'volume_create_manager' (c9f955a6-07c0-47af-892d-4d67430eaf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985cacfe-ea80-481f-b415-f91338724b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (985cacfe-ea80-481f-b415-f91338724b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1266588395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54ef67d-57a8-4280-9c1b-cab2aed1d9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7fea6a74194eb0832d3ef20d841d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:16:20Z,use_quota=True,user_id='1075925d5e884cbb8b1d070da193812d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbe9dac-044a-4045-8886-fb59ac2006b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dbe9dac-044a-4045-8886-fb59ac2006b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9b6af9-142e-4763-a3c2-182ff589ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9b6af9-142e-4763-a3c2-182ff589ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'volume_name': 'volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346857a4-1e1c-43cc-adaf-edc1700b685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346857a4-1e1c-43cc-adaf-edc1700b685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a266e85-6d55-45d6-b25c-f3c7c6d3e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Volume a54ef67d-57a8-4280-9c1b-cab2aed1d9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'volume_size': 1}
Jul 06 13:16:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:21 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee 1073741824" returned: 0 in 1.214s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:21 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee
Jul 06 13:16:21 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "cinder-790895f6-87f5-461d-b681-54b9de048321-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:22 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee" returned: 0 in 0.891s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1266588395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54ef67d-57a8-4280-9c1b-cab2aed1d9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7fea6a74194eb0832d3ef20d841d6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:16:20Z,use_quota=True,user_id='1075925d5e884cbb8b1d070da193812d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Creating volume a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:16:22 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "cinder-790895f6-87f5-461d-b681-54b9de048321-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:22 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 1073741824
Jul 06 13:16:22 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a860ccc-8cb6-4dcb-9836-17080d8207ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d10746-84a0-4c78-999e-49044e25bfee', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd6578b-2dbd-493a-82f6-f2d06ee9ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Volume volume-d2d10746-84a0-4c78-999e-49044e25bfee (d2d10746-84a0-4c78-999e-49044e25bfee): created successfully
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dd6578b-2dbd-493a-82f6-f2d06ee9ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Flow 'volume_create_manager' (3b5094e6-6e2e-40b0-98d0-f5e95eba8562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "cinder-quobyte-790895f6-87f5-461d-b681-54b9de048321" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8256fab9-e6d0-4182-964d-2122c77974f3 tempest-GroupSnapshotsV319Test-1104413497 None] Created volume successfully.
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "cinder-quobyte-790895f6-87f5-461d-b681-54b9de048321" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbebb56-693d-421c-8944-564f8b364757]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:22 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321
Jul 06 13:16:22 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:23 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321" returned: 0 in 1.104s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:23 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321
Jul 06 13:16:23 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:23 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 1073741824" returned: 0 in 1.373s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:24 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2
Jul 06 13:16:24 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] GroupSnapshot 8b681250-6645-4278-b3b0-0625fa2600d4: creating.
Jul 06 13:16:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Group snapshot 8b681250-6645-4278-b3b0-0625fa2600d4: creating. {{(pid=86698) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 13:16:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:24 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-790895f6-87f5-461d-b681-54b9de048321" returned: 0 in 1.011s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "cinder-quobyte-790895f6-87f5-461d-b681-54b9de048321" released by "delete_volume" :: held 2.171s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Created reservations ['c66d4b1a-339d-4d63-be38-5c786b9c01f0', 'e2d645f6-b601-4201-aad2-4b291f422a77', '41bc861f-ad95-4efe-9028-9ea683bf6254', '96b5ea9a-890e-47c6-b38a-887aedfe3663'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:16:25 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" returned: 0 in 0.998s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] <== create_volume: return (2433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a266e85-6d55-45d6-b25c-f3c7c6d3e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94553b8f-b162-4a1c-9186-bf0d759dd2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Creating offline snapshot b44f2d41-ca38-4a02-b5ff-b518c030c072 of volume d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:16:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Volume volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 (a54ef67d-57a8-4280-9c1b-cab2aed1d9f2): created successfully
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94553b8f-b162-4a1c-9186-bf0d759dd2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Flow 'volume_create_manager' (c9f955a6-07c0-47af-892d-4d67430eaf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c106cda-d0e0-4a72-848b-dcd9f77206be]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-265f4096-5c90-4c1b-a240-c833793bf1dc tempest-ServerActionsTestOtherA-1122902164 None] Created volume successfully.
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:25 devstack sudo[88152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:16:25 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:25 devstack sudo[88151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee
Jul 06 13:16:25 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:26 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.778s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:26 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:16:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Deleted volume successfully.
Jul 06 13:16:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6275a330-36dc-4b24-bad2-c4953e619c49 tempest-DeleteServersTestJSON-23064254 None] Lock "cinder-790895f6-87f5-461d-b681-54b9de048321-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:26 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee" returned: 0 in 0.935s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:26 devstack sudo[88159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 1G
Jul 06 13:16:26 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:27 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 1G" returned: 0 in 1.053s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d10746-84a0-4c78-999e-49044e25bfee -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:27 devstack sudo[88165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d10746-84a0-4c78-999e-49044e25bfee -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072
Jul 06 13:16:27 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:28 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d10746-84a0-4c78-999e-49044e25bfee -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072" returned: 0 in 0.865s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:28 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:16:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:28 devstack sudo[88172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072
Jul 06 13:16:28 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:28 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072" returned: 0 in 0.788s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:28 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info
Jul 06 13:16:28 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:29 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:29 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:16:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:29 devstack sudo[88180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info
Jul 06 13:16:29 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:30 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.info" returned: 0 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.455s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6cba106c-2aca-4d1d-a32e-bf67c5148b55 tempest-GroupSnapshotsV319Test-1104413497 None] group_snapshot 8b681250-6645-4278-b3b0-0625fa2600d4: created successfully
Jul 06 13:16:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] group_snapshot 8b681250-6645-4278-b3b0-0625fa2600d4: deleting
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] group_snapshot 8b681250-6645-4278-b3b0-0625fa2600d4: deleting {{(pid=86698) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "cinder-quobyte-b44f2d41-ca38-4a02-b5ff-b518c030c072" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-b44f2d41-ca38-4a02-b5ff-b518c030c072" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Deleting offline snapshot b44f2d41-ca38-4a02-b5ff-b518c030c072 of volume d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] snapshot_file for this snap is: volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b153c58-b9bb-4106-b1e7-e54c79469abb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:31 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072
Jul 06 13:16:31 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:32 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072" returned: 0 in 0.913s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d10746-84a0-4c78-999e-49044e25bfee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:16:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690e84e-df39-41dd-b750-1cf191be4394]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:32 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee
Jul 06 13:16:32 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:33 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee" returned: 0 in 1.196s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:33 devstack sudo[88218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072
Jul 06 13:16:33 devstack sudo[88218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:34 devstack sudo[88218]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072" returned: 0 in 1.031s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:34 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072
Jul 06 13:16:34 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:35 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee.b44f2d41-ca38-4a02-b5ff-b518c030c072" returned: 0 in 1.000s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-b44f2d41-ca38-4a02-b5ff-b518c030c072" released by "_delete_snapshot" :: held 4.353s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" released by "delete_snapshot" :: held 4.399s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:35 devstack cinder-volume[86698]: WARNING cinder.quota [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-215699372 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-215699372, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:16:35 devstack cinder-volume[86698]: WARNING cinder.quota [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-215699372 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-215699372, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:16:35 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] Created reservations ['f592a316-f99f-417f-b6fb-36fcb2a2dbf6', 'ed1303b6-bb6b-43ef-a270-dd2c9c174b68', 'e792364b-0184-485a-b77b-5b94071cbb70', '04020dd4-6e01-4352-a198-9e68daa9edf5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:16:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2939666f-e23d-4953-8d03-e1b893f29066 tempest-GroupSnapshotsV319Test-1104413497 None] group_snapshot 8b681250-6645-4278-b3b0-0625fa2600d4: deleted successfully
Jul 06 13:16:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:16:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:16:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d5f31-f781-4f30-9be0-074c312819c6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:16:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:37 devstack sudo[88248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee
Jul 06 13:16:37 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:38 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee" returned: 0 in 0.926s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:38 devstack sudo[88254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee
Jul 06 13:16:38 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:39 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d2d10746-84a0-4c78-999e-49044e25bfee" returned: 0 in 0.993s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "cinder-quobyte-d2d10746-84a0-4c78-999e-49044e25bfee" released by "delete_volume" :: held 2.060s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:16:39 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Created reservations ['1105035a-88dc-441d-9070-6e98c02ff925'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:16:39 devstack cinder-volume[86698]: WARNING cinder.quota [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-215699372 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-215699372, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:16:39 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Created reservations ['acd0c555-9d27-4b1c-b745-381cc030fd7f', '68a857b9-3622-4280-93e3-ccbf27577458', '20ded1dd-9d5a-4f9f-91cc-a7e93c5f2484', '9670b429-8433-4e3a-aded-a7034c2752c5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:16:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:16:40 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:16:40 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:16:41 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Jul 06 13:16:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.042s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:16:41 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:16:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9b301179-ee58-4893-b7c3-47e8b19652f5 tempest-GroupSnapshotsV319Test-1104413497 None] Delete group completed successfully.
Jul 06 13:16:50 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=49,cinder:UPDATE=46,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:16:50 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=53,cinder:SELECT=45,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:17:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:17:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Flow 'volume_create_manager' (03f0f8bd-9afb-4890-86d7-2919214c04aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d25619b-4ba9-4e26-b638-095b5b4a5536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d25619b-4ba9-4e26-b638-095b5b4a5536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2021880731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59127cb-b23a-4c48-9f52-1570303ffe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efed0f7441574d58baa2ba279f00e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:08Z,use_quota=True,user_id='5a872b3794764613affc9dc1e6c0c82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba1690c-7a8d-4db0-9088-3da788e5c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ba1690c-7a8d-4db0-9088-3da788e5c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809c162a-ac0c-4d30-bb44-0c1d31d67809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809c162a-ac0c-4d30-bb44-0c1d31d67809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59127cb-b23a-4c48-9f52-1570303ffe5d', 'volume_name': 'volume-f59127cb-b23a-4c48-9f52-1570303ffe5d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d591ec2-cb50-429f-920f-c334171315c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d591ec2-cb50-429f-920f-c334171315c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9951cc-ea37-4e4f-9aba-6b58d716b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:08 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Volume f59127cb-b23a-4c48-9f52-1570303ffe5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59127cb-b23a-4c48-9f52-1570303ffe5d', 'volume_size': 1}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2021880731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59127cb-b23a-4c48-9f52-1570303ffe5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efed0f7441574d58baa2ba279f00e4ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:08Z,use_quota=True,user_id='5a872b3794764613affc9dc1e6c0c82e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Creating volume f59127cb-b23a-4c48-9f52-1570303ffe5d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:17:08 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:17:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:08 devstack sudo[88371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d 1073741824
Jul 06 13:17:08 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:09 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d 1073741824" returned: 0 in 1.164s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:09 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d
Jul 06 13:17:09 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:10 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d" returned: 0 in 0.785s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9951cc-ea37-4e4f-9aba-6b58d716b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59127cb-b23a-4c48-9f52-1570303ffe5d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00252342-90a4-4df2-9c77-92d4c1575607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:10 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Volume volume-f59127cb-b23a-4c48-9f52-1570303ffe5d (f59127cb-b23a-4c48-9f52-1570303ffe5d): created successfully
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00252342-90a4-4df2-9c77-92d4c1575607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Flow 'volume_create_manager' (03f0f8bd-9afb-4890-86d7-2919214c04aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6bc06f62-0826-4530-b3ff-54b3866dbce0 tempest-TaggedAttachmentsTest-1729293523 None] Created volume successfully.
Jul 06 13:17:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a26ccb-64da-4cff-ae64-3bd7159c3553]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:13 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2
Jul 06 13:17:13 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:14 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" returned: 0 in 1.163s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.192s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84c93e62-c9a7-4473-92f4-e752e0f2dde8', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:17:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-6ed770b7-1ab8-4b60-b81d-ed964eac8c85 req-faa1e56d-37af-4fe2-9e3f-7108581cbe67 tempest-ServerActionsTestOtherA-1122902164 None] attachment_update completed successfully.
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:18 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:17:18 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:19 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.802s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Flow 'volume_create_manager' (695e11e6-ce7d-4d19-ac18-17b77cf0f22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ab50bc-21c0-498a-b07a-7bbd971ec80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ab50bc-21c0-498a-b07a-7bbd971ec80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1001927176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce8f6dd-5578-4713-ac7e-72c26462ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3db19ea90f949a7a5302e4b5179a912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:22Z,use_quota=True,user_id='6ac162342cc14540a5a5a8c80cf6d71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e0b914-5967-407c-8881-c9437de0ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e0b914-5967-407c-8881-c9437de0ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200812ac-a91e-4cb6-939a-907b7d50245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200812ac-a91e-4cb6-939a-907b7d50245f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce8f6dd-5578-4713-ac7e-72c26462ceff', 'volume_name': 'volume-dce8f6dd-5578-4713-ac7e-72c26462ceff', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dee8b6-0a71-47da-b2f0-d9ee4f88de25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66dee8b6-0a71-47da-b2f0-d9ee4f88de25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24972724-5f8e-4316-974e-a32418ab74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume dce8f6dd-5578-4713-ac7e-72c26462ceff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce8f6dd-5578-4713-ac7e-72c26462ceff', 'volume_size': 1}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1001927176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce8f6dd-5578-4713-ac7e-72c26462ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3db19ea90f949a7a5302e4b5179a912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:22Z,use_quota=True,user_id='6ac162342cc14540a5a5a8c80cf6d71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Creating volume dce8f6dd-5578-4713-ac7e-72c26462ceff {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:17:22 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:17:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:22 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff 1073741824
Jul 06 13:17:22 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-9a9ad7f8-dc78-483a-8804-fb9585a04a7c tempest-ServerActionsTestOtherA-1122902164 None] Terminate volume connection completed successfully.
Jul 06 13:17:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-9a9ad7f8-dc78-483a-8804-fb9585a04a7c tempest-ServerActionsTestOtherA-1122902164 None] Deleting attachment 84c93e62-c9a7-4473-92f4-e752e0f2dde8. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:17:24 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff 1073741824" returned: 0 in 1.770s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:24 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff
Jul 06 13:17:24 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:26 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff" returned: 0 in 1.506s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] <== create_volume: return (3370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.386s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24972724-5f8e-4316-974e-a32418ab74f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce8f6dd-5578-4713-ac7e-72c26462ceff', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9364716d-9d85-4b05-9496-8c888add3715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Flow 'volume_create_manager' (6e52e476-e977-4800-ba7d-a4f3eb451e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d46083-d063-4313-8c55-fe342ea7665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume volume-dce8f6dd-5578-4713-ac7e-72c26462ceff (dce8f6dd-5578-4713-ac7e-72c26462ceff): created successfully
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9364716d-9d85-4b05-9496-8c888add3715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Flow 'volume_create_manager' (695e11e6-ce7d-4d19-ac18-17b77cf0f22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d46083-d063-4313-8c55-fe342ea7665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-522458091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72410612-659a-4526-9c12-f7f12a14e1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eb17e811ac4acab3a6508b26dbe23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:26Z,use_quota=True,user_id='1037badb7b0b49828c9b7a33f0afd246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecedbbc-459f-4ecd-af78-fa5b8397a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecedbbc-459f-4ecd-af78-fa5b8397a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82d28ec-33a1-444e-a18d-1a1d45034823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82d28ec-33a1-444e-a18d-1a1d45034823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72410612-659a-4526-9c12-f7f12a14e1b6', 'volume_name': 'volume-72410612-659a-4526-9c12-f7f12a14e1b6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce3fc52-9004-4d76-9973-5175ad7bee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce3fc52-9004-4d76-9973-5175ad7bee6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8425c52-7e53-4ab8-a069-bc65f7c9f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Volume 72410612-659a-4526-9c12-f7f12a14e1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72410612-659a-4526-9c12-f7f12a14e1b6', 'volume_size': 1}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-522458091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72410612-659a-4526-9c12-f7f12a14e1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eb17e811ac4acab3a6508b26dbe23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:26Z,use_quota=True,user_id='1037badb7b0b49828c9b7a33f0afd246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Creating volume 72410612-659a-4526-9c12-f7f12a14e1b6 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:17:26 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-de7c50c2-eac3-4426-8c40-4e760d548985 tempest-VolumeQuotasAdminTestJSON-525512533 None] Created volume successfully.
Jul 06 13:17:26 devstack sudo[88980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 1073741824
Jul 06 13:17:26 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "cinder-dce8f6dd-5578-4713-ac7e-72c26462ceff-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "cinder-dce8f6dd-5578-4713-ac7e-72c26462ceff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "cinder-quobyte-dce8f6dd-5578-4713-ac7e-72c26462ceff" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "cinder-quobyte-dce8f6dd-5578-4713-ac7e-72c26462ceff" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9551e0-8bd5-4292-8a9b-51a2b72689e2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:27 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff
Jul 06 13:17:27 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:27 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 1073741824" returned: 0 in 1.105s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:27 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6
Jul 06 13:17:27 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:28 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff" returned: 0 in 1.001s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:28 devstack sudo[88998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff
Jul 06 13:17:28 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:28 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.750s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8425c52-7e53-4ab8-a069-bc65f7c9f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72410612-659a-4526-9c12-f7f12a14e1b6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e20d10-5d26-424c-a630-e7fedd24b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72ae263-5f64-48ed-a883-ec136b769516]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Volume volume-72410612-659a-4526-9c12-f7f12a14e1b6 (72410612-659a-4526-9c12-f7f12a14e1b6): created successfully
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e20d10-5d26-424c-a630-e7fedd24b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Flow 'volume_create_manager' (6e52e476-e977-4800-ba7d-a4f3eb451e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1a426f99-3baf-4ccf-84ad-f3076ed4f7e3 tempest-VolumesAdminNegativeTest-414424231 None] Created volume successfully.
Jul 06 13:17:28 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2
Jul 06 13:17:28 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dce8f6dd-5578-4713-ac7e-72c26462ceff" returned: 0 in 0.758s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:28 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "cinder-quobyte-dce8f6dd-5578-4713-ac7e-72c26462ceff" released by "delete_volume" :: held 1.830s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Created reservations ['a22fe178-bc62-4465-9b4a-b22f6628c4ae', '5431fa7b-cfc0-4774-8e43-b30218a5736b', '489cdef3-b13f-42d9-9396-38da809f3d2e', 'a5ef81d4-dbfc-444c-906f-5bb71d258f9a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:29 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:17:29 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:29 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" returned: 0 in 1.549s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.630s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a207481b-347e-4255-8b9e-21c3e2bc18f4', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:17:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-3ed162c6-f305-41fb-a880-b48f7c1961a9 req-e10a20f6-bf7e-4a11-aaec-504ec6f9503b tempest-ServerActionsTestOtherA-1122902164 None] attachment_update completed successfully.
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Acquiring lock "cinder-72410612-659a-4526-9c12-f7f12a14e1b6-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "cinder-72410612-659a-4526-9c12-f7f12a14e1b6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Acquiring lock "cinder-quobyte-72410612-659a-4526-9c12-f7f12a14e1b6" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "cinder-quobyte-72410612-659a-4526-9c12-f7f12a14e1b6" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa57c603-4653-4592-a24a-0f2e929073b4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:30 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.546s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:30 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Flow 'volume_create_manager' (ad9e8583-e7d2-4823-836e-af62c508e3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fbd44b-6437-4a39-8039-a53532441d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Deleted volume successfully.
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fbd44b-6437-4a39-8039-a53532441d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-109203740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c77705-8d3e-4efd-a752-c9c402df1b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3db19ea90f949a7a5302e4b5179a912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:31Z,use_quota=True,user_id='6ac162342cc14540a5a5a8c80cf6d71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b4a31-48dd-4a70-bd67-ebc9459f45f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626b4a31-48dd-4a70-bd67-ebc9459f45f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7482f5f-7399-4150-82c5-6731f1c3844e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7482f5f-7399-4150-82c5-6731f1c3844e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c77705-8d3e-4efd-a752-c9c402df1b49', 'volume_name': 'volume-a2c77705-8d3e-4efd-a752-c9c402df1b49', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fcc81-2f2e-4461-a629-1660a198a0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:31 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6
Jul 06 13:17:31 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fcc81-2f2e-4461-a629-1660a198a0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bf8f75-5e18-4731-be7e-b02ea59a2454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:31 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume a2c77705-8d3e-4efd-a752-c9c402df1b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c77705-8d3e-4efd-a752-c9c402df1b49', 'volume_size': 1}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-109203740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c77705-8d3e-4efd-a752-c9c402df1b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3db19ea90f949a7a5302e4b5179a912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:31Z,use_quota=True,user_id='6ac162342cc14540a5a5a8c80cf6d71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Creating volume a2c77705-8d3e-4efd-a752-c9c402df1b49 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:17:31 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:31 devstack sudo[89061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 1073741824
Jul 06 13:17:31 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65264ce4-27f2-4b7a-a072-5134c1728808 tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "cinder-dce8f6dd-5578-4713-ac7e-72c26462ceff-delete_volume" released by "delete_volume" :: held 4.151s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:32 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6" returned: 0 in 1.223s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:32 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6
Jul 06 13:17:32 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:32 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 1073741824" returned: 0 in 1.453s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:32 devstack sudo[89098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49
Jul 06 13:17:32 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:33 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-72410612-659a-4526-9c12-f7f12a14e1b6" returned: 0 in 1.331s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "cinder-quobyte-72410612-659a-4526-9c12-f7f12a14e1b6" released by "delete_volume" :: held 2.650s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Created reservations ['9b7beda5-334d-4303-88eb-7680d038001d', 'e0f4291c-24b1-4e25-b960-0f9d1929e0ed', 'f899c00e-4f23-442c-8c9a-08b6efb33b8d', '7bb058c7-dded-48a7-bf1d-b4d213e135d2'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:33 devstack sudo[89116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:17:33 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:33 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49" returned: 0 in 1.226s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] <== create_volume: return (2784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:17:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.796s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15bf8f75-5e18-4731-be7e-b02ea59a2454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c77705-8d3e-4efd-a752-c9c402df1b49', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a6ebb3-63ce-4ab0-913b-dc50ccea283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Volume volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 (a2c77705-8d3e-4efd-a752-c9c402df1b49): created successfully
Jul 06 13:17:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a6ebb3-63ce-4ab0-913b-dc50ccea283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Flow 'volume_create_manager' (ad9e8583-e7d2-4823-836e-af62c508e3f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-976facc2-b6ff-407e-ac32-8f005021d4cd tempest-VolumeQuotasAdminTestJSON-525512533 None] Created volume successfully.
Jul 06 13:17:35 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.490s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:35 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:17:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Deleted volume successfully.
Jul 06 13:17:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4e75402e-ee1f-4df4-9451-6572534a88c2 tempest-VolumesAdminNegativeTest-414424231 None] Lock "cinder-72410612-659a-4526-9c12-f7f12a14e1b6-delete_volume" released by "delete_volume" :: held 4.695s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c0ae6d38-f2b1-441c-a861-df7b2cd7166f tempest-VolumeQuotasAdminTestJSON-104339645 None] Transfer volume completed successfully.
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Acquiring lock "cinder-a2c77705-8d3e-4efd-a752-c9c402df1b49-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "cinder-a2c77705-8d3e-4efd-a752-c9c402df1b49-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Acquiring lock "cinder-quobyte-a2c77705-8d3e-4efd-a752-c9c402df1b49" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "cinder-quobyte-a2c77705-8d3e-4efd-a752-c9c402df1b49" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec7a41-11b4-4343-9e08-da0ea209acff]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:38 devstack sudo[89595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49
Jul 06 13:17:38 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:39 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49" returned: 0 in 1.295s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:39 devstack sudo[89606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49
Jul 06 13:17:39 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:40 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c77705-8d3e-4efd-a752-c9c402df1b49" returned: 0 in 0.949s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "cinder-quobyte-a2c77705-8d3e-4efd-a752-c9c402df1b49" released by "delete_volume" :: held 2.337s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:40 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Created reservations ['200e7c42-fc68-4d8a-a33c-461bae0a8045', 'ecb0c943-8366-46d9-a02e-03f1d8a9f26f', '7c4ebf29-0408-49be-bcc6-6beff407344b', '9e11bf16-664e-44f4-af33-ed7ab37e5e3e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:41 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:17:41 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:42 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.167s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:42 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:17:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Deleted volume successfully.
Jul 06 13:17:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-306af743-321a-4b31-9322-cda978c35f3f tempest-VolumeQuotasAdminTestJSON-1003208469 None] Lock "cinder-a2c77705-8d3e-4efd-a752-c9c402df1b49-delete_volume" released by "delete_volume" :: held 3.941s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:17:51 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:17:52 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=42,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:17:52 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:17:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Flow 'volume_create_manager' (3b580025-70d0-45ca-8b2e-752aaec0a2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155801e-eeb6-4faa-8cb1-df9345da53cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c155801e-eeb6-4faa-8cb1-df9345da53cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-149115576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b977364f-9b19-481f-be83-b10fae488d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87666694f0f14de9bae84d1f302d958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:53Z,use_quota=True,user_id='7df6514896ad4b11b8d50004a85a9beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e792fab1-b8ca-4407-94d2-be6920c47061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e792fab1-b8ca-4407-94d2-be6920c47061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5585f97-55a6-486a-8e7f-859b8869b4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5585f97-55a6-486a-8e7f-859b8869b4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b977364f-9b19-481f-be83-b10fae488d2d', 'volume_name': 'volume-b977364f-9b19-481f-be83-b10fae488d2d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15a078-fedd-4ebc-b80a-e8dc9ad976be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db15a078-fedd-4ebc-b80a-e8dc9ad976be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf97d348-1f6b-4691-a78e-1021bae5b0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Volume b977364f-9b19-481f-be83-b10fae488d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b977364f-9b19-481f-be83-b10fae488d2d', 'volume_size': 1}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-149115576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b977364f-9b19-481f-be83-b10fae488d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87666694f0f14de9bae84d1f302d958a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:17:53Z,use_quota=True,user_id='7df6514896ad4b11b8d50004a85a9beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Creating volume b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:17:53 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:17:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:53 devstack sudo[89641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d 1073741824
Jul 06 13:17:53 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:54 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d 1073741824" returned: 0 in 1.178s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:54 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d
Jul 06 13:17:54 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:55 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d" returned: 0 in 0.792s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf97d348-1f6b-4691-a78e-1021bae5b0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b977364f-9b19-481f-be83-b10fae488d2d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d47962-3e15-4cd6-b775-6d68088d036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:17:55 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Volume volume-b977364f-9b19-481f-be83-b10fae488d2d (b977364f-9b19-481f-be83-b10fae488d2d): created successfully
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d47962-3e15-4cd6-b775-6d68088d036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:17:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Flow 'volume_create_manager' (3b580025-70d0-45ca-8b2e-752aaec0a2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:17:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0641b042-239f-4036-8875-9e8261c579d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Created volume successfully.
Jul 06 13:17:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:17:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:17:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Creating offline snapshot a28623ae-3b68-4c7a-b381-2953e3c45f30 of volume b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:17:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a33a67-979d-4ace-9139-c579111e7872]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:17:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:56 devstack sudo[89758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d
Jul 06 13:17:56 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:57 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d" returned: 0 in 0.917s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:57 devstack sudo[89763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 1G
Jul 06 13:17:57 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:58 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 1G" returned: 0 in 0.881s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b977364f-9b19-481f-be83-b10fae488d2d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:58 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b977364f-9b19-481f-be83-b10fae488d2d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30
Jul 06 13:17:58 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:59 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b977364f-9b19-481f-be83-b10fae488d2d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:59 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 is being set with open permissions: ugo+rw
Jul 06 13:17:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:59 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30
Jul 06 13:17:59 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:17:59 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Jul 06 13:17:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30" returned: 0 in 0.700s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:17:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:17:59 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info
Jul 06 13:17:59 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:00 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:00 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info is being set with open permissions: ugo+rw
Jul 06 13:18:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:00 devstack sudo[89787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info
Jul 06 13:18:00 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:01 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.info" returned: 0 in 0.688s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.749s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:01 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-302a97f1-08fc-4eea-90e0-cfd033cd5a6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Create snapshot completed successfully
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "cinder-a28623ae-3b68-4c7a-b381-2953e3c45f30-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-a28623ae-3b68-4c7a-b381-2953e3c45f30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "cinder-quobyte-a28623ae-3b68-4c7a-b381-2953e3c45f30" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-a28623ae-3b68-4c7a-b381-2953e3c45f30" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Deleting offline snapshot a28623ae-3b68-4c7a-b381-2953e3c45f30 of volume b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] snapshot_file for this snap is: volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[955a0e61-6a33-49df-8d69-cd2f951b2e04]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:02 devstack sudo[89807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30
Jul 06 13:18:02 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:03 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30" returned: 0 in 1.079s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b977364f-9b19-481f-be83-b10fae488d2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:18:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed92b908-ba97-4e78-a9af-53115b1273bb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:03 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d
Jul 06 13:18:03 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:04 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d" returned: 0 in 0.957s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:04 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30
Jul 06 13:18:04 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:05 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30" returned: 0 in 0.878s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:05 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30
Jul 06 13:18:05 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:06 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d.a28623ae-3b68-4c7a-b381-2953e3c45f30" returned: 0 in 0.782s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-a28623ae-3b68-4c7a-b381-2953e3c45f30" released by "_delete_snapshot" :: held 3.877s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" released by "delete_snapshot" :: held 3.921s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:06 devstack cinder-volume[86698]: WARNING cinder.quota [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:18:06 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Created reservations ['1d46160c-e995-4b90-aec2-90739dbb950a', '2f699864-2b74-4889-9d50-007721a4e442', '15d096ad-a945-4660-8c14-e269ec3a3a49', 'f9fe3c4d-be9b-4a13-ba64-8467ee52dcd2'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Delete snapshot completed successfully.
Jul 06 13:18:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-54e552eb-5251-41b8-bc22-1832bb473847 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-a28623ae-3b68-4c7a-b381-2953e3c45f30-delete_snapshot" released by "delete_snapshot" :: held 4.143s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "cinder-b977364f-9b19-481f-be83-b10fae488d2d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-b977364f-9b19-481f-be83-b10fae488d2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c852cf09-9051-49c0-bb9c-3eef495f720c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-0b079b1b-e12b-44cc-86e7-4cc3b05d7232 req-36028bdb-3986-4544-95a0-4fb27337b3f1 tempest-ServerActionsTestOtherA-1122902164 None] Terminate volume connection completed successfully.
Jul 06 13:18:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-0b079b1b-e12b-44cc-86e7-4cc3b05d7232 req-36028bdb-3986-4544-95a0-4fb27337b3f1 tempest-ServerActionsTestOtherA-1122902164 None] Deleting attachment a207481b-347e-4255-8b9e-21c3e2bc18f4. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:18:07 devstack sudo[89838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d
Jul 06 13:18:07 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d" returned: 0 in 1.316s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:08 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:08 devstack sudo[89859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d
Jul 06 13:18:08 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:09 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b977364f-9b19-481f-be83-b10fae488d2d" returned: 0 in 1.373s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-quobyte-b977364f-9b19-481f-be83-b10fae488d2d" released by "delete_volume" :: held 2.801s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Created reservations ['f6a362dc-ef21-4d28-bec3-d6ded47c749f', 'eb42a05b-1790-4932-bc3b-2fe0e56f9484', '292b87e8-512b-4b7a-92be-fa22e61c64a4', '0373fe9e-44b9-4a85-a475-612597d462bc'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:10 devstack sudo[89894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:10 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:11 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.887s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:11 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Deleted volume successfully.
Jul 06 13:18:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-397d3158-383d-48b5-877f-a6c2a995a884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1289042352 None] Lock "cinder-b977364f-9b19-481f-be83-b10fae488d2d-delete_volume" released by "delete_volume" :: held 4.056s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dc3729-38d2-4a43-95c3-0811c3ed1e83]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:16 devstack sudo[89947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d
Jul 06 13:18:16 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:17 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d" returned: 0 in 0.876s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-f59127cb-b23a-4c48-9f52-1570303ffe5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51b1f246-aa3b-48bc-a338-7d72ba732413', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:18:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-1a8e7086-3e6d-4764-894a-f1a278be3d71 req-f9e1bd5a-41e8-4de3-9c19-ef5f11db671b tempest-TaggedAttachmentsTest-1729293523 None] attachment_update completed successfully.
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Flow 'volume_create_manager' (fde67ffa-d886-41d5-af3d-76339b567f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf27a15-d399-4d92-ab9e-e70b2cb01e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf27a15-d399-4d92-ab9e-e70b2cb01e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-356752839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292d7401-8263-4e1c-9781-eecede2fbf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361f7a4320374c9487ebc0e8fc75714d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:18Z,use_quota=True,user_id='bdfced78e3d64fb3804d6e2d4bd4d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd15f33-0a3b-461d-bea5-80815796bd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd15f33-0a3b-461d-bea5-80815796bd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3543ea-81d3-47d1-b706-f6808be71544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3543ea-81d3-47d1-b706-f6808be71544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292d7401-8263-4e1c-9781-eecede2fbf5f', 'volume_name': 'volume-292d7401-8263-4e1c-9781-eecede2fbf5f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6de2dce-77e3-4010-999e-1bab486498e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6de2dce-77e3-4010-999e-1bab486498e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a11ca1b-8fb6-420a-b83c-d4931e5516ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Volume 292d7401-8263-4e1c-9781-eecede2fbf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292d7401-8263-4e1c-9781-eecede2fbf5f', 'volume_size': 1}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-356752839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292d7401-8263-4e1c-9781-eecede2fbf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361f7a4320374c9487ebc0e8fc75714d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:18Z,use_quota=True,user_id='bdfced78e3d64fb3804d6e2d4bd4d2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Creating volume 292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:18:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:18 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f 1073741824
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:18 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:18 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:18 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:19 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.926s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 8 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:18:19 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f 1073741824" returned: 0 in 1.167s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:19 devstack sudo[90349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f
Jul 06 13:18:19 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "cinder-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "cinder-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "cinder-quobyte-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "cinder-quobyte-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f82d8-4a0c-47b3-afe1-c131f6a72850]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:20 devstack sudo[90351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2
Jul 06 13:18:20 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:20 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a11ca1b-8fb6-420a-b83c-d4931e5516ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292d7401-8263-4e1c-9781-eecede2fbf5f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116033b6-775f-4a25-89a2-7cacd4481a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Volume volume-292d7401-8263-4e1c-9781-eecede2fbf5f (292d7401-8263-4e1c-9781-eecede2fbf5f): created successfully
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116033b6-775f-4a25-89a2-7cacd4481a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Flow 'volume_create_manager' (fde67ffa-d886-41d5-af3d-76339b567f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-921cdd89-cc92-4d1e-9ec6-6194ccede9e4 tempest-SnapshotMetadataTestJSON-2105374670 None] Created volume successfully.
Jul 06 13:18:20 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" returned: 0 in 0.796s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:20 devstack sudo[90357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2
Jul 06 13:18:20 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:21 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" returned: 0 in 0.679s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "cinder-quobyte-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2" released by "delete_volume" :: held 1.519s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Created reservations ['c9abc194-4c76-4675-aa6f-2261eb30a96a', 'b04da79b-a7b2-4ec0-a9dc-d0caacce36e9', '2e782e96-f62a-4277-b67e-61307f821881', '44256cdc-d18d-466d-82da-fb499d53df07'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Creating offline snapshot 00367119-4da5-4990-937f-246993bfff7f of volume 292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d26d9-f21d-47ad-af3b-71ae67b63767]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:21 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:21 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:21 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f
Jul 06 13:18:21 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:22 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:22 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Deleted volume successfully.
Jul 06 13:18:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-360898e3-849d-4579-a05f-f3606f1d0be1 tempest-ServerActionsTestOtherA-1122902164 None] Lock "cinder-a54ef67d-57a8-4280-9c1b-cab2aed1d9f2-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:22 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f" returned: 0 in 0.833s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:22 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f 1G
Jul 06 13:18:22 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:23 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f 1G" returned: 0 in 1.155s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292d7401-8263-4e1c-9781-eecede2fbf5f -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:23 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292d7401-8263-4e1c-9781-eecede2fbf5f -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f
Jul 06 13:18:23 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:24 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-292d7401-8263-4e1c-9781-eecede2fbf5f -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f" returned: 0 in 1.065s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:24 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f is being set with open permissions: ugo+rw
Jul 06 13:18:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:24 devstack sudo[90411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f
Jul 06 13:18:24 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:25 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f" returned: 0 in 0.957s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:25 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info
Jul 06 13:18:25 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-e259ff88-e495-41c4-b404-ce23162f9702 req-c4cf2517-5ca7-49f3-b28c-478861395878 tempest-TaggedAttachmentsTest-1729293523 None] Terminate volume connection completed successfully.
Jul 06 13:18:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-e259ff88-e495-41c4-b404-ce23162f9702 req-c4cf2517-5ca7-49f3-b28c-478861395878 tempest-TaggedAttachmentsTest-1729293523 None] Deleting attachment 51b1f246-aa3b-48bc-a338-7d72ba732413. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:18:26 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info" returned: 0 in 0.765s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:26 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info is being set with open permissions: ugo+rw
Jul 06 13:18:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:26 devstack sudo[90465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info
Jul 06 13:18:26 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:27 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.info" returned: 0 in 0.698s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.629s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4ae1c526-baa3-463d-98ec-8ca45bf7e9fc tempest-SnapshotMetadataTestJSON-2105374670 None] Create snapshot completed successfully
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "cinder-00367119-4da5-4990-937f-246993bfff7f-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-00367119-4da5-4990-937f-246993bfff7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "cinder-quobyte-00367119-4da5-4990-937f-246993bfff7f" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-00367119-4da5-4990-937f-246993bfff7f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Deleting offline snapshot 00367119-4da5-4990-937f-246993bfff7f of volume 292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] snapshot_file for this snap is: volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d65fd5-1922-4df6-8d16-34c2db5e4fe1]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:29 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f
Jul 06 13:18:29 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:29 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f" returned: 0 in 1.021s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-292d7401-8263-4e1c-9781-eecede2fbf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:18:30 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c04646-96e9-4369-ad5c-89150539b93a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:30 devstack sudo[90531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f
Jul 06 13:18:30 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:30 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f" returned: 0 in 0.928s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:31 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f
Jul 06 13:18:31 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:32 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f" returned: 0 in 1.085s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:32 devstack sudo[90574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f
Jul 06 13:18:32 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:33 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f.00367119-4da5-4990-937f-246993bfff7f" returned: 0 in 0.940s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-00367119-4da5-4990-937f-246993bfff7f" released by "_delete_snapshot" :: held 4.247s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" released by "delete_snapshot" :: held 4.290s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:33 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Created reservations ['f9fab5fd-a94c-47e2-985e-e2c3c9395409', '5cfc96f2-7023-4f07-ba35-4214eb13570e', 'a449f48d-50b5-4e8a-ba28-9e78d3c7349f', '3b5ce23e-bbf5-4a70-8174-063d76f3f0ad'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Delete snapshot completed successfully.
Jul 06 13:18:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a14ac85-712b-414d-aefc-e6bb5bfbb98b tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-00367119-4da5-4990-937f-246993bfff7f-delete_snapshot" released by "delete_snapshot" :: held 4.603s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "cinder-292d7401-8263-4e1c-9781-eecede2fbf5f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-292d7401-8263-4e1c-9781-eecede2fbf5f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[62138127-2e72-4872-b520-9a0ad200858e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:34 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f
Jul 06 13:18:34 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:35 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f" returned: 0 in 1.372s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:35 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f
Jul 06 13:18:35 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:36 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292d7401-8263-4e1c-9781-eecede2fbf5f" returned: 0 in 1.100s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-quobyte-292d7401-8263-4e1c-9781-eecede2fbf5f" released by "delete_volume" :: held 2.562s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Created reservations ['784d328b-5cb9-44d7-b76b-f7422f5ca288', '4b5d31f9-64c0-4520-9b40-a64769356f3c', 'a8c04a85-168f-4eae-8072-5fc3260927f9', '9e61d3f9-6dd8-465d-b5b1-8f89a40dbec1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:37 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:37 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:38 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.445s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:38 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Deleted volume successfully.
Jul 06 13:18:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d557690e-1729-454a-915f-e15f2413b231 tempest-SnapshotMetadataTestJSON-2105374670 None] Lock "cinder-292d7401-8263-4e1c-9781-eecede2fbf5f-delete_volume" released by "delete_volume" :: held 4.518s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:44 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:18:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Flow 'volume_create_manager' (ae8b6e4b-e19e-4c3f-b1bf-b20b914e3d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4486f34-5fd3-40ac-ad4d-dd35f81c4918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4486f34-5fd3-40ac-ad4d-dd35f81c4918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1698729910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481e8c59-7901-41d1-be0d-0a8a458bcf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f84b2a714ea4212bf91b7f6c7b75a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:45Z,use_quota=True,user_id='f0446c526bea43519c5d79f517658ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcdbf7a-7839-4603-ac88-a93773a1aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebcdbf7a-7839-4603-ac88-a93773a1aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e685a1-40ae-45e2-974b-85c5e0757d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e685a1-40ae-45e2-974b-85c5e0757d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '481e8c59-7901-41d1-be0d-0a8a458bcf52', 'volume_name': 'volume-481e8c59-7901-41d1-be0d-0a8a458bcf52', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc56da6-77db-4075-acd9-458c1c7679b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efc56da6-77db-4075-acd9-458c1c7679b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bb962a-3bc1-4af2-8c5e-64a6c9ee65fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:45 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Volume 481e8c59-7901-41d1-be0d-0a8a458bcf52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-481e8c59-7901-41d1-be0d-0a8a458bcf52', 'volume_size': 1}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1698729910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=481e8c59-7901-41d1-be0d-0a8a458bcf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f84b2a714ea4212bf91b7f6c7b75a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:45Z,use_quota=True,user_id='f0446c526bea43519c5d79f517658ba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Creating volume 481e8c59-7901-41d1-be0d-0a8a458bcf52 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:45 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 1073741824
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:18:45 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:45 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e13b08b1-321c-4e26-9dff-e41bc2c3240c tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-541609567: creating
Jul 06 13:18:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e13b08b1-321c-4e26-9dff-e41bc2c3240c tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-541609567: created successfully
Jul 06 13:18:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e13b08b1-321c-4e26-9dff-e41bc2c3240c tempest-GroupSnapshotsTest-13427710 None] Create group completed successfully.
Jul 06 13:18:45 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 1073741824" returned: 0 in 0.905s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:45 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52
Jul 06 13:18:45 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:46 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bb962a-3bc1-4af2-8c5e-64a6c9ee65fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-481e8c59-7901-41d1-be0d-0a8a458bcf52', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d086f7-35e5-48fe-a6db-a04a2f24d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Volume volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 (481e8c59-7901-41d1-be0d-0a8a458bcf52): created successfully
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d086f7-35e5-48fe-a6db-a04a2f24d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Flow 'volume_create_manager' (ae8b6e4b-e19e-4c3f-b1bf-b20b914e3d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-47752f3e-6464-44b8-b6b9-81178f3a04f6 tempest-VolumesMetadataTest-1062416294 None] Created volume successfully.
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (d3d38c54-8474-4b14-b416-fb421b3ef1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc59fd84-7132-4559-8f9e-15a41bad4cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc59fd84-7132-4559-8f9e-15a41bad4cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434233148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=489980f5-7c6e-4af4-a618-457902faedf1,host='devstack@QuobyteHD#QuobyteHD',id=4445b8cd-28fa-4334-9765-a6cf89867dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:47Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6feffd9d-4f42-495c-a2b6-7b11cd5396e0),volume_type_id=6feffd9d-4f42-495c-a2b6-7b11cd5396e0)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06ca9f0-9d68-4d84-a7b1-3b72db7af0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06ca9f0-9d68-4d84-a7b1-3b72db7af0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff6ce7-6abd-41bd-88bd-56e76d67f084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff6ce7-6abd-41bd-88bd-56e76d67f084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4445b8cd-28fa-4334-9765-a6cf89867dac', 'volume_name': 'volume-4445b8cd-28fa-4334-9765-a6cf89867dac', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1017205-ec17-4285-877f-975a7c5b4920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1017205-ec17-4285-877f-975a7c5b4920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93302d65-c098-426e-8197-bddfdeb75477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:47 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Volume 4445b8cd-28fa-4334-9765-a6cf89867dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4445b8cd-28fa-4334-9765-a6cf89867dac', 'volume_size': 1}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=489980f5-7c6e-4af4-a618-457902faedf1,created_at=2026-07-06T11:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1434233148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=489980f5-7c6e-4af4-a618-457902faedf1,host='devstack@QuobyteHD#QuobyteHD',id=4445b8cd-28fa-4334-9765-a6cf89867dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:18:47Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6feffd9d-4f42-495c-a2b6-7b11cd5396e0),volume_type_id=6feffd9d-4f42-495c-a2b6-7b11cd5396e0)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Creating volume 4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:18:47 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "cinder-f59127cb-b23a-4c48-9f52-1570303ffe5d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:47 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac 1073741824
Jul 06 13:18:47 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "cinder-f59127cb-b23a-4c48-9f52-1570303ffe5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "cinder-quobyte-f59127cb-b23a-4c48-9f52-1570303ffe5d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "cinder-quobyte-f59127cb-b23a-4c48-9f52-1570303ffe5d" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4476f189-8ede-4eda-8da6-46f03a5361cf]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:47 devstack sudo[90679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d
Jul 06 13:18:47 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:48 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac 1073741824" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:48 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d" returned: 0 in 0.986s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:48 devstack sudo[90691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:18:48 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:48 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d
Jul 06 13:18:48 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Acquiring lock "cinder-481e8c59-7901-41d1-be0d-0a8a458bcf52-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "cinder-481e8c59-7901-41d1-be0d-0a8a458bcf52-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Acquiring lock "cinder-quobyte-481e8c59-7901-41d1-be0d-0a8a458bcf52" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "cinder-quobyte-481e8c59-7901-41d1-be0d-0a8a458bcf52" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158889c-7ed9-4bcb-afd1-5da5b756f2af]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:49 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52
Jul 06 13:18:49 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:49 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.086s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93302d65-c098-426e-8197-bddfdeb75477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4445b8cd-28fa-4334-9765-a6cf89867dac', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48cf8e9-480d-42d5-bd9b-5519c4aa9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:18:49 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Volume volume-4445b8cd-28fa-4334-9765-a6cf89867dac (4445b8cd-28fa-4334-9765-a6cf89867dac): created successfully
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48cf8e9-480d-42d5-bd9b-5519c4aa9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (d3d38c54-8474-4b14-b416-fb421b3ef1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:18:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e06deead-62fb-4f13-a05e-c1354504f263 tempest-GroupSnapshotsTest-13427710 None] Created volume successfully.
Jul 06 13:18:49 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f59127cb-b23a-4c48-9f52-1570303ffe5d" returned: 0 in 1.206s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "cinder-quobyte-f59127cb-b23a-4c48-9f52-1570303ffe5d" released by "delete_volume" :: held 2.242s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Created reservations ['5b4f270e-52f3-40a7-aaca-7c1909b2fe8f', 'bbc30608-dcbd-4306-8430-259a56de7ece', '44d8e028-7083-4b7b-9f91-3ab0fc1b78e7', '7313159c-236d-4099-b42a-bed2e0b87343'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:49 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:49 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] GroupSnapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: creating.
Jul 06 13:18:50 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Group snapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: creating. {{(pid=86698) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52" returned: 0 in 1.299s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:50 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52
Jul 06 13:18:50 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Creating offline snapshot b49d820a-3dc5-481e-af0c-0b1e88022d1b of volume 4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d134033a-9b9d-47af-9d4c-3c1fa6a15a79]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:18:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:51 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:18:51 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:51 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.323s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Deleted volume successfully.
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=62,cinder:SELECT=59,cinder:DELETE=7,cinder:INSERT=14 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ad8479f-4f65-4e7e-95c7-f7a0280bc08d tempest-TaggedAttachmentsTest-1729293523 None] Lock "cinder-f59127cb-b23a-4c48-9f52-1570303ffe5d-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:51 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-481e8c59-7901-41d1-be0d-0a8a458bcf52" returned: 0 in 1.309s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "cinder-quobyte-481e8c59-7901-41d1-be0d-0a8a458bcf52" released by "delete_volume" :: held 2.682s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Created reservations ['e5667efa-f8b6-4416-a871-8b20d1d8cb6d', 'df3b168d-7246-485c-aaf2-6be30faaad23', '54506472-79f1-4699-b7bd-b089c0f04108', '44fd05d1-588b-4722-920a-4152f0572de5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:52 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:18:52 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:52 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:52 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b 1G
Jul 06 13:18:52 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:53 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.471s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:53 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:18:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Deleted volume successfully.
Jul 06 13:18:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48ac6614-a456-4193-95a6-781eac69754e tempest-VolumesMetadataTest-1062416294 None] Lock "cinder-481e8c59-7901-41d1-be0d-0a8a458bcf52-delete_volume" released by "delete_volume" :: held 4.629s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:18:54 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b 1G" returned: 0 in 1.854s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4445b8cd-28fa-4334-9765-a6cf89867dac -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:54 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4445b8cd-28fa-4334-9765-a6cf89867dac -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:18:54 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:55 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4445b8cd-28fa-4334-9765-a6cf89867dac -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 1.181s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:55 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:18:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:55 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:18:55 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:56 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 1.177s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:56 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=67,cinder:DELETE=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:18:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:56 devstack sudo[90815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info
Jul 06 13:18:56 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:57 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info" returned: 0 in 1.234s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:57 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:18:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:18:57 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info
Jul 06 13:18:58 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:18:59 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Jul 06 13:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.info" returned: 0 in 1.086s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:18:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.444s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:18:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5efcdf67-0832-4d29-9d83-2902b03c168f tempest-GroupSnapshotsTest-13427710 None] group_snapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: created successfully
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b-bfea4830-8639-4e75-802c-c89f4663b096" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b-bfea4830-8639-4e75-802c-c89f4663b096" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Creating volume bfea4830-8639-4e75-802c-c89f4663b096 from snapshot b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] snapshot: b49d820a-3dc5-481e-af0c-0b1e88022d1b, volume: bfea4830-8639-4e75-802c-c89f4663b096,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd107ed-84b1-4c48-a5ab-6566f37039d2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:01 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:19:01 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Flow 'volume_create_manager' (6dbf3102-3c46-4605-ba30-d06752bfb2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f266b7e-bbb2-4a49-b62f-e98e6668abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f266b7e-bbb2-4a49-b62f-e98e6668abca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-84764781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe31b872-5759-4ad3-a0f6-247210f546f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3875a6c7ef4f5291d92d74dc149af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:01Z,use_quota=True,user_id='feb2b538d5be4105ac77a6b68eb9d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5a1267-b3db-4903-a616-f36dda92a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e5a1267-b3db-4903-a616-f36dda92a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4494dbed-8a95-4f2a-b23e-f3b0f3313c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4494dbed-8a95-4f2a-b23e-f3b0f3313c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe31b872-5759-4ad3-a0f6-247210f546f0', 'volume_name': 'volume-fe31b872-5759-4ad3-a0f6-247210f546f0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e31c118-03d7-4cae-a2b6-a7705a101253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e31c118-03d7-4cae-a2b6-a7705a101253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c569fdb-3a9f-4d40-a6df-e9d3393ce3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Volume fe31b872-5759-4ad3-a0f6-247210f546f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe31b872-5759-4ad3-a0f6-247210f546f0', 'volume_size': 1}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:01 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 1.008s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4445b8cd-28fa-4334-9765-a6cf89867dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3910d5-2be7-4a5b-aa52-103419ed3cb9]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:02 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:19:02 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:02 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.015s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:02 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:19:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:02 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096
Jul 06 13:19:02 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:04 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Flow 'volume_create_manager' (5bd9d208-4b04-452f-a37a-fb65493eb36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d688931-9990-4f2d-9570-d23d97aad021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d688931-9990-4f2d-9570-d23d97aad021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-321109732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece2c66b-48dd-4406-a36a-681d793ec6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1565b291be2c445cb51aa6f832bf3085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:05Z,use_quota=True,user_id='c480d8a7287e4b14bc78bc9ecd192816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5d4a9d-0e47-40e1-9d7c-349a9bcc3204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5d4a9d-0e47-40e1-9d7c-349a9bcc3204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3124d3-9fc8-456b-8818-2045f73bfa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3124d3-9fc8-456b-8818-2045f73bfa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece2c66b-48dd-4406-a36a-681d793ec6d4', 'volume_name': 'volume-ece2c66b-48dd-4406-a36a-681d793ec6d4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7004f3c-4226-45fa-a9d5-d19e9a10b20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7004f3c-4226-45fa-a9d5-d19e9a10b20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bc5151-7b7d-4140-9384-220477f10b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Volume ece2c66b-48dd-4406-a36a-681d793ec6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece2c66b-48dd-4406-a36a-681d793ec6d4', 'volume_size': 1}
Jul 06 13:19:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:08 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096" returned: 0 in 6.011s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc599d7-aef9-4cd6-a89d-f7738593f8b3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:09 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:19:09 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:10 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.049s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:19:10 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Converted 1024.00 MB image at 170.34 MB/s
Jul 06 13:19:10 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:10 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096
Jul 06 13:19:10 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:10 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096" returned: 0 in 0.801s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" released by "_copy_volume_from_snapshot" :: held 10.008s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b-bfea4830-8639-4e75-802c-c89f4663b096" released by "_create_volume_from_snapshot" :: held 10.057s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.101s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.553s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-84764781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe31b872-5759-4ad3-a0f6-247210f546f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3875a6c7ef4f5291d92d74dc149af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:01Z,use_quota=True,user_id='feb2b538d5be4105ac77a6b68eb9d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Creating volume fe31b872-5759-4ad3-a0f6-247210f546f0 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:10 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:10 devstack sudo[90912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 1073741824
Jul 06 13:19:10 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-17eae96a-5e41-4beb-bafe-97593f152a75 tempest-GroupSnapshotsTest-13427710 None] Create group from source-snapshot-6536d020-cd72-4d52-ac33-902c93f0a76c completed successfully.
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:11 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 1073741824" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc220b3-01e9-4907-a7a9-7caecf6f6d3e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:11 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0
Jul 06 13:19:11 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:12 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096
Jul 06 13:19:12 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:12 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0" returned: 0 in 0.800s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.587s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-321109732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece2c66b-48dd-4406-a36a-681d793ec6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1565b291be2c445cb51aa6f832bf3085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:05Z,use_quota=True,user_id='c480d8a7287e4b14bc78bc9ecd192816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Creating volume ece2c66b-48dd-4406-a36a-681d793ec6d4 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:12 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:12 devstack sudo[90927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 1073741824
Jul 06 13:19:12 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c569fdb-3a9f-4d40-a6df-e9d3393ce3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe31b872-5759-4ad3-a0f6-247210f546f0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130d537d-1e0c-4788-9b76-2cc449290af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:12 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Volume volume-fe31b872-5759-4ad3-a0f6-247210f546f0 (fe31b872-5759-4ad3-a0f6-247210f546f0): created successfully
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130d537d-1e0c-4788-9b76-2cc449290af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Flow 'volume_create_manager' (6dbf3102-3c46-4605-ba30-d06752bfb2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6943a2fe-ded3-447f-8ff8-7b7065906fb8 tempest-VolumesTransfersV355Test-1599237587 None] Created volume successfully.
Jul 06 13:19:12 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096" returned: 0 in 0.988s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:12 devstack sudo[90929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096
Jul 06 13:19:12 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:13 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 1073741824" returned: 0 in 1.050s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:13 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bfea4830-8639-4e75-802c-c89f4663b096" returned: 0 in 0.990s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:13 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4
Jul 06 13:19:13 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-bfea4830-8639-4e75-802c-c89f4663b096" released by "delete_volume" :: held 2.056s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['6a3e1e3e-31e1-4036-b1eb-75700ce79404'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:14 devstack cinder-volume[86698]: WARNING cinder.quota [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-930105302 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-930105302, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:19:14 devstack cinder-volume[86698]: WARNING cinder.quota [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-930105302 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-930105302, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['ef17d5d7-7722-477a-96d2-07f76cf2fbbc', '8524d989-7d32-42e5-b686-ce84ed528f99', 'b240d7a7-9bd5-4f40-b2f0-14dbe90e5e11', '49c6f050-311a-461b-bd22-afecf320cada'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:14 devstack sudo[90938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:14 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: deleting
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: deleting {{(pid=86698) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Deleting offline snapshot b49d820a-3dc5-481e-af0c-0b1e88022d1b of volume 4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] snapshot_file for this snap is: volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e82a1b5-31eb-4d35-af18-53ff674c4acc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:14 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4" returned: 0 in 1.084s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.224s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bc5151-7b7d-4140-9384-220477f10b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece2c66b-48dd-4406-a36a-681d793ec6d4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade2ab62-5c41-4521-899d-13b6a04479e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:15 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:19:15 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-23ae8e26-c249-4844-a9f2-b060ddc1695f tempest-VolumesTransfersV355Test-2114177477 None] Transfer volume completed successfully.
Jul 06 13:19:15 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Volume volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 (ece2c66b-48dd-4406-a36a-681d793ec6d4): created successfully
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade2ab62-5c41-4521-899d-13b6a04479e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Flow 'volume_create_manager' (5bd9d208-4b04-452f-a37a-fb65493eb36d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2ea26446-8f0e-46ae-93ad-95c73feb4f59 tempest-ServersNegativeTestJSON-384711692 None] Created volume successfully.
Jul 06 13:19:15 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.007s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:15 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e57e7ee9-3bd5-49e4-b495-5dad56bc0c48 tempest-GroupSnapshotsTest-13427710 None] Delete group completed successfully.
Jul 06 13:19:15 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 1.151s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4445b8cd-28fa-4334-9765-a6cf89867dac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d55c8-2a33-414f-896a-480f936af9b6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:16 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:19:16 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "cinder-fe31b872-5759-4ad3-a0f6-247210f546f0-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-fe31b872-5759-4ad3-a0f6-247210f546f0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "cinder-quobyte-fe31b872-5759-4ad3-a0f6-247210f546f0" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-quobyte-fe31b872-5759-4ad3-a0f6-247210f546f0" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e73579b-0a4c-4c43-bc5f-00fbb66d5811]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:16 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0
Jul 06 13:19:16 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:17 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.230s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:17 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:19:17 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:17 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0" returned: 0 in 1.228s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:17 devstack sudo[90967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0
Jul 06 13:19:17 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Flow 'volume_create_manager' (bb445737-8414-4a85-a523-f98fd2db531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca0c9d2-f89e-4ef7-8f1f-d77c17c80bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca0c9d2-f89e-4ef7-8f1f-d77c17c80bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2072908753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ea4a21-6460-43c0-93c7-4b6573876999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1565b291be2c445cb51aa6f832bf3085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:18Z,use_quota=True,user_id='c480d8a7287e4b14bc78bc9ecd192816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4935a0-733c-4522-9515-c4018000646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4935a0-733c-4522-9515-c4018000646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152e06a3-303e-4b63-a53f-93c2ac0a5ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152e06a3-303e-4b63-a53f-93c2ac0a5ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ea4a21-6460-43c0-93c7-4b6573876999', 'volume_name': 'volume-b1ea4a21-6460-43c0-93c7-4b6573876999', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ccdb1a-e660-470b-aae8-fedae37eec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ccdb1a-e660-470b-aae8-fedae37eec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006f723-f6d6-4354-9987-4896cad50bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Volume b1ea4a21-6460-43c0-93c7-4b6573876999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ea4a21-6460-43c0-93c7-4b6573876999', 'volume_size': 1}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2072908753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ea4a21-6460-43c0-93c7-4b6573876999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1565b291be2c445cb51aa6f832bf3085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:18Z,use_quota=True,user_id='c480d8a7287e4b14bc78bc9ecd192816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Creating volume b1ea4a21-6460-43c0-93c7-4b6573876999 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:18 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 1073741824
Jul 06 13:19:18 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:18 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 1.176s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:18 devstack sudo[90974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:18 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:18 devstack sudo[90975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b
Jul 06 13:19:18 devstack sudo[90975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:18 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fe31b872-5759-4ad3-a0f6-247210f546f0" returned: 0 in 1.018s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-quobyte-fe31b872-5759-4ad3-a0f6-247210f546f0" released by "delete_volume" :: held 2.311s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Created reservations ['fb71d03b-c4c5-4c3a-93bf-daab0dd947ec', 'e348d203-1eff-4b3f-bf42-c6d63e21c8d8', '07155faf-cdf3-47e6-9015-d345f6b43fc5', '06eb35a6-cf5a-4b65-815a-d00402a8bd2f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:19 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:19 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:19 devstack sudo[90975]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac.b49d820a-3dc5-481e-af0c-0b1e88022d1b" returned: 0 in 0.928s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-b49d820a-3dc5-481e-af0c-0b1e88022d1b" released by "_delete_snapshot" :: held 4.690s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" released by "delete_snapshot" :: held 4.746s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:19 devstack cinder-volume[86698]: WARNING cinder.quota [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-930105302 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-930105302, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['2da135cc-383d-482e-a5ce-39c94f21eb3f', '0fb6b87b-b3ec-4dec-a373-c6e48337e88d', '3c7a12e7-305a-4737-b13f-348d8f3d8b33', '499454b9-1808-455f-b3a1-1f891380d2ca'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:19 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.321s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 8 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:19:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6604968d-4e9b-44f3-a928-471497659889 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 6536d020-cd72-4d52-ac33-902c93f0a76c: deleted successfully
Jul 06 13:19:19 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 1073741824" returned: 0 in 1.774s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:20 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999
Jul 06 13:19:20 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:20 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.143s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Deleted volume successfully.
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-63a3ea2e-a5ea-4f31-89b8-b4e73d37f8fd tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-fe31b872-5759-4ad3-a0f6-247210f546f0-delete_volume" released by "delete_volume" :: held 3.885s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256863e-f4e9-431c-a5be-f22180a5a00d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:21 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Flow 'volume_create_manager' (f0223549-ab93-4e4c-a1a4-700497cda12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:21 devstack sudo[90990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:19:21 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3ec45-a89c-4371-98f1-87ce06b5053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999" returned: 0 in 1.205s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] <== create_volume: return (3042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.044s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c3ec45-a89c-4371-98f1-87ce06b5053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-236556742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f2f310-5a02-4daf-bcbc-2f383ac0d4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3875a6c7ef4f5291d92d74dc149af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:21Z,use_quota=True,user_id='feb2b538d5be4105ac77a6b68eb9d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2b087a-aee6-4b78-b0c0-76e7a61cf2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2b087a-aee6-4b78-b0c0-76e7a61cf2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c6b19a-384d-45cb-be17-4311fed296bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c6b19a-384d-45cb-be17-4311fed296bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93f2f310-5a02-4daf-bcbc-2f383ac0d4cc', 'volume_name': 'volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5493639-12cb-4bb7-b6c5-ea7f79023f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5493639-12cb-4bb7-b6c5-ea7f79023f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f250fafe-f5ae-43cf-a99c-9298b39b77e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Volume 93f2f310-5a02-4daf-bcbc-2f383ac0d4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc', 'volume_size': 1}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-236556742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93f2f310-5a02-4daf-bcbc-2f383ac0d4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd3875a6c7ef4f5291d92d74dc149af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:21Z,use_quota=True,user_id='feb2b538d5be4105ac77a6b68eb9d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Creating volume 93f2f310-5a02-4daf-bcbc-2f383ac0d4cc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:21 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e006f723-f6d6-4354-9987-4896cad50bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ea4a21-6460-43c0-93c7-4b6573876999', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83af444-2d3b-485d-9074-7b56b734ccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:21 devstack sudo[90993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc 1073741824
Jul 06 13:19:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Volume volume-b1ea4a21-6460-43c0-93c7-4b6573876999 (b1ea4a21-6460-43c0-93c7-4b6573876999): created successfully
Jul 06 13:19:21 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b83af444-2d3b-485d-9074-7b56b734ccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Flow 'volume_create_manager' (bb445737-8414-4a85-a523-f98fd2db531a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-920ad329-905a-4105-805e-6a7053b9ea3c tempest-ServersNegativeTestJSON-384711692 None] Created volume successfully.
Jul 06 13:19:22 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 1.146s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:22 devstack sudo[90999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac
Jul 06 13:19:22 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:22 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc 1073741824" returned: 0 in 1.241s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:22 devstack sudo[91005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc
Jul 06 13:19:22 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "cinder-b1ea4a21-6460-43c0-93c7-4b6573876999-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-b1ea4a21-6460-43c0-93c7-4b6573876999-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "cinder-quobyte-b1ea4a21-6460-43c0-93c7-4b6573876999" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-quobyte-b1ea4a21-6460-43c0-93c7-4b6573876999" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:22 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4445b8cd-28fa-4334-9765-a6cf89867dac" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c01473-47f6-4939-9498-a2f3ed6527e9]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-4445b8cd-28fa-4334-9765-a6cf89867dac" released by "delete_volume" :: held 2.128s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['5dbea10b-2f08-4611-9f25-68a92e53f91f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:23 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999
Jul 06 13:19:23 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:23 devstack cinder-volume[86698]: WARNING cinder.db.api [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-930105302']
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['527c8cc8-43f9-475f-a2db-dd9a5877d574', '3b155bfc-6435-4d20-9f61-01bd3227a5d3', 'f8daf525-b3a1-4e32-92eb-1579e7ce7701', '6622d60f-4bac-4c00-bf4f-5aeec59da5e1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:23 devstack sudo[91011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:23 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:23 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" returned: 0 in 0.797s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f250fafe-f5ae-43cf-a99c-9298b39b77e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3014dd-3b7f-4204-8cbc-9ffbed6859da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Volume volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc (93f2f310-5a02-4daf-bcbc-2f383ac0d4cc): created successfully
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a3014dd-3b7f-4204-8cbc-9ffbed6859da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Flow 'volume_create_manager' (f0223549-ab93-4e4c-a1a4-700497cda12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8f335c0e-5065-4183-a4c8-a3b02789dda5 tempest-VolumesTransfersV355Test-1599237587 None] Created volume successfully.
Jul 06 13:19:23 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999" returned: 0 in 0.941s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:23 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999
Jul 06 13:19:23 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:24 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5052d670-837a-4038-ab8b-602f9380e1a3 tempest-GroupSnapshotsTest-13427710 None] Delete group completed successfully.
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "cinder-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:24 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b1ea4a21-6460-43c0-93c7-4b6573876999" returned: 0 in 0.956s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-quobyte-b1ea4a21-6460-43c0-93c7-4b6573876999" released by "delete_volume" :: held 1.974s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "cinder-quobyte-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-quobyte-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Created reservations ['239c7841-5145-49a0-a91b-9a14b3320bf3', '31eb5b26-f440-495a-ad18-989eafb7f71f', 'fd18eaf8-5075-4ffb-b3d6-d2796ec29069', '5ed92b1f-7043-44d0-b37f-987000bc3659'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710d2f1-ac14-4de9-bad7-3286a0902a93]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:25 devstack sudo[91024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc
Jul 06 13:19:25 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:25 devstack sudo[91027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:25 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "cinder-ece2c66b-48dd-4406-a36a-681d793ec6d4-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-406ccd5f-75fd-4880-aa85-b6028f403cde tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-1905733214: creating
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-ece2c66b-48dd-4406-a36a-681d793ec6d4-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-406ccd5f-75fd-4880-aa85-b6028f403cde tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-1905733214: created successfully
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "cinder-quobyte-ece2c66b-48dd-4406-a36a-681d793ec6d4" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-406ccd5f-75fd-4880-aa85-b6028f403cde tempest-GroupSnapshotsTest-13427710 None] Create group completed successfully.
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-quobyte-ece2c66b-48dd-4406-a36a-681d793ec6d4" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d781b40-c062-4f69-a1e3-4c5bef06bfe7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:25 devstack sudo[91034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4
Jul 06 13:19:25 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:26 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" returned: 0 in 1.107s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:26 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc
Jul 06 13:19:26 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:26 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.945s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Deleted volume successfully.
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b5f51bf-c1d9-4d15-85f4-47da355759de tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-b1ea4a21-6460-43c0-93c7-4b6573876999-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:26 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4" returned: 0 in 0.979s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:26 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4
Jul 06 13:19:26 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:27 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" returned: 0 in 0.945s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-quobyte-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc" released by "delete_volume" :: held 2.136s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (daeaab8d-1155-4e00-bdb0-8da62400081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c5b1c-d842-4d9d-a1a8-dd516d64781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2c5b1c-d842-4d9d-a1a8-dd516d64781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437106784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,host='devstack@QuobyteHD#QuobyteHD',id=1ca7a2d2-b394-49bc-9275-8c0bd82aad97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:27Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce1e97a-ca80-4575-b7b9-4ea8676ef446),volume_type_id=4ce1e97a-ca80-4575-b7b9-4ea8676ef446)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6f4747-f477-4dd9-9397-58751745786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6f4747-f477-4dd9-9397-58751745786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb55fe80-e768-4911-90e1-ba2d4703e19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb55fe80-e768-4911-90e1-ba2d4703e19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca7a2d2-b394-49bc-9275-8c0bd82aad97', 'volume_name': 'volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6b8764-8e7f-4cf3-ad80-98ce51465aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6b8764-8e7f-4cf3-ad80-98ce51465aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569fe485-6847-4cad-9c81-955a182dcc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Volume 1ca7a2d2-b394-49bc-9275-8c0bd82aad97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97', 'volume_size': 1}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,created_at=2026-07-06T11:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-437106784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,host='devstack@QuobyteHD#QuobyteHD',id=1ca7a2d2-b394-49bc-9275-8c0bd82aad97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:27Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce1e97a-ca80-4575-b7b9-4ea8676ef446),volume_type_id=4ce1e97a-ca80-4575-b7b9-4ea8676ef446)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Creating volume 1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:27 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:27 devstack sudo[91050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 1073741824
Jul 06 13:19:27 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Created reservations ['70a363d1-ad8c-4215-8903-260b1d8a7679', '10f28ac9-517c-4f9c-838b-54eef6380d45', '16f44bd8-3bae-4136-8e18-1e4a4a82321e', '58e68533-fc85-4791-86bb-a513786c2aa2'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:27 devstack sudo[91053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:27 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:27 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ece2c66b-48dd-4406-a36a-681d793ec6d4" returned: 0 in 0.997s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-quobyte-ece2c66b-48dd-4406-a36a-681d793ec6d4" released by "delete_volume" :: held 2.028s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Created reservations ['0e4b26be-d28c-496b-a392-7626eae69e2a', '42f17d3f-bb95-4950-91b5-887ede84cdf1', '9e416349-64ba-4bd9-97e8-581dec83f6cf', '74470366-a845-46a9-a3b8-ecd8104f91a7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:27 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:19:27 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:28 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.781s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Deleted volume successfully.
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d2777779-fb6c-4a47-a102-24b3ee9c5e39 tempest-VolumesTransfersV355Test-685814124 None] Lock "cinder-93f2f310-5a02-4daf-bcbc-2f383ac0d4cc-delete_volume" released by "delete_volume" :: held 3.494s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:28 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 1073741824" returned: 0 in 1.102s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:28 devstack sudo[91064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97
Jul 06 13:19:28 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:28 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.926s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:19:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Deleted volume successfully.
Jul 06 13:19:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b709ad74-2b82-4ae2-bfbd-5c6c2c45f5f1 tempest-ServersNegativeTestJSON-384711692 None] Lock "cinder-ece2c66b-48dd-4406-a36a-681d793ec6d4-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:19:29 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" returned: 0 in 0.884s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569fe485-6847-4cad-9c81-955a182dcc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda2933b-dad3-4f4a-91df-aff1fee6f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Volume volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 (1ca7a2d2-b394-49bc-9275-8c0bd82aad97): created successfully
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda2933b-dad3-4f4a-91df-aff1fee6f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (daeaab8d-1155-4e00-bdb0-8da62400081f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d9015675-31d7-4cb2-a711-af2e18ac7431 tempest-GroupSnapshotsTest-13427710 None] Created volume successfully.
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (b01dd919-46a9-443b-a818-3d6b1b7f44d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b69221-67ab-446d-9907-0e8a1244c68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11b69221-67ab-446d-9907-0e8a1244c68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316831803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,host='devstack@QuobyteHD#QuobyteHD',id=db1a3f3b-ff93-432b-867b-067f9fb76656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:31Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce1e97a-ca80-4575-b7b9-4ea8676ef446),volume_type_id=4ce1e97a-ca80-4575-b7b9-4ea8676ef446)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfa727c-d3c3-4167-acd0-d34c206accdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfa727c-d3c3-4167-acd0-d34c206accdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e41680-f8e7-4a05-a1b0-612d119c8147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e41680-f8e7-4a05-a1b0-612d119c8147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1a3f3b-ff93-432b-867b-067f9fb76656', 'volume_name': 'volume-db1a3f3b-ff93-432b-867b-067f9fb76656', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66462066-79c1-4f90-bfd4-ce08a05eae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66462066-79c1-4f90-bfd4-ce08a05eae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dbecea-0f2f-4da6-9dff-8bd946be8b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Volume db1a3f3b-ff93-432b-867b-067f9fb76656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1a3f3b-ff93-432b-867b-067f9fb76656', 'volume_size': 1}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,created_at=2026-07-06T11:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1316831803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=699dc2cc-cb99-4522-ac08-9e97c3b88260,host='devstack@QuobyteHD#QuobyteHD',id=db1a3f3b-ff93-432b-867b-067f9fb76656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:31Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce1e97a-ca80-4575-b7b9-4ea8676ef446),volume_type_id=4ce1e97a-ca80-4575-b7b9-4ea8676ef446)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Creating volume db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:30 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 1073741824
Jul 06 13:19:30 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:32 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 1073741824" returned: 0 in 1.526s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:32 devstack sudo[91111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656
Jul 06 13:19:32 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:33 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656" returned: 0 in 0.957s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] <== create_volume: return (2539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.541s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dbecea-0f2f-4da6-9dff-8bd946be8b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1a3f3b-ff93-432b-867b-067f9fb76656', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf83048-2c79-465d-b512-92c5b4b05b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Volume volume-db1a3f3b-ff93-432b-867b-067f9fb76656 (db1a3f3b-ff93-432b-867b-067f9fb76656): created successfully
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf83048-2c79-465d-b512-92c5b4b05b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (b01dd919-46a9-443b-a818-3d6b1b7f44d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-059240bb-f2eb-45c6-8b67-0998095411bf tempest-GroupSnapshotsTest-13427710 None] Created volume successfully.
Jul 06 13:19:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-72fd72d0-1903-4f2a-98de-e828e44e97d5 tempest-GroupSnapshotsTest-13427710 None] Update group completed successfully.
Jul 06 13:19:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7c4d7832-c345-4980-9c9c-800d3ac75b48 tempest-GroupSnapshotsTest-13427710 None] Update group completed successfully.
Jul 06 13:19:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-698e0afa-c453-4c6b-a557-c00c607d8337 tempest-GroupSnapshotsTest-13427710 None] Update group completed successfully.
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Flow 'volume_create_manager' (92f38c2f-275a-422e-9e7e-5ce58d53d7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5678899-b4a4-4a17-9eec-c7a5b6e7a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5678899-b4a4-4a17-9eec-c7a5b6e7a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-551821065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b5a4c-ade1-402d-aab3-c956b2474250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24a927e787c41a894859aec728171ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:37Z,use_quota=True,user_id='306de94793564c03af64096fd42c2ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e90317-bd73-4d21-b616-5733e59e7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e90317-bd73-4d21-b616-5733e59e7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262f9c98-c94e-43ae-8306-98f51d609012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262f9c98-c94e-43ae-8306-98f51d609012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1b5a4c-ade1-402d-aab3-c956b2474250', 'volume_name': 'volume-cc1b5a4c-ade1-402d-aab3-c956b2474250', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddf9d58-7c6f-4011-9b8d-36e1ca50c322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ddf9d58-7c6f-4011-9b8d-36e1ca50c322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c09c34-10b1-4476-9240-719de66b4cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:37 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Volume cc1b5a4c-ade1-402d-aab3-c956b2474250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1b5a4c-ade1-402d-aab3-c956b2474250', 'volume_size': 1}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-551821065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1b5a4c-ade1-402d-aab3-c956b2474250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24a927e787c41a894859aec728171ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:37Z,use_quota=True,user_id='306de94793564c03af64096fd42c2ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Creating volume cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:19:37 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:19:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:37 devstack sudo[91181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 1073741824
Jul 06 13:19:37 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1841ce5b-3064-4ec7-b7de-4eb201ba1b0e tempest-GroupSnapshotsTest-13427710 None] Update group completed successfully.
Jul 06 13:19:38 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 1073741824" returned: 0 in 1.276s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:38 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:19:38 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:40 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.246s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c09c34-10b1-4476-9240-719de66b4cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1b5a4c-ade1-402d-aab3-c956b2474250', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b1792-9608-47b7-a32a-af2d6cdbff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:40 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Volume volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 (cc1b5a4c-ade1-402d-aab3-c956b2474250): created successfully
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38b1792-9608-47b7-a32a-af2d6cdbff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Flow 'volume_create_manager' (92f38c2f-275a-422e-9e7e-5ce58d53d7cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9942d7c9-ce3c-406d-8621-bbe9e5cfe703 tempest-VolumesCloneTest-504575888 None] Created volume successfully.
Jul 06 13:19:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] GroupSnapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: creating.
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Group snapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: creating. {{(pid=86698) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Creating offline snapshot 7794e81e-605a-4b05-bfea-c4c46f12af1a of volume 1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23c8dc-9ec7-4f37-8d92-c2faf3b88e92]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:40 devstack sudo[91235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97
Jul 06 13:19:40 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:42 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" returned: 0 in 1.314s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:42 devstack sudo[91263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a 1G
Jul 06 13:19:42 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Flow 'volume_create_manager' (e2119f97-0044-4598-9192-e5e9e7fad662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634b0754-d647-4610-98e1-4d8427831494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (634b0754-d647-4610-98e1-4d8427831494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-736317543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892f2bfa-144a-4750-a22f-efb52ed0bc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24a927e787c41a894859aec728171ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:19:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=cc1b5a4c-ade1-402d-aab3-c956b2474250,status='creating',terminated_at=None,updated_at=2026-07-06T11:19:42Z,use_quota=True,user_id='306de94793564c03af64096fd42c2ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316f072-aebd-4e8e-9f2f-fd7ce81e2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316f072-aebd-4e8e-9f2f-fd7ce81e2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ca71a3-d56d-465e-a7eb-1376b6472909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ca71a3-d56d-465e-a7eb-1376b6472909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '892f2bfa-144a-4750-a22f-efb52ed0bc9b', 'volume_name': 'volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b', 'volume_size': 2, 'source_volid': 'cc1b5a4c-ade1-402d-aab3-c956b2474250', 'source_volstatus': 'available'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e235a1-e972-4ea1-b39d-b0cc5c104e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e235a1-e972-4ea1-b39d-b0cc5c104e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f8b46c-65aa-4d91-b2a2-2662b7ca8510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:19:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Volume 892f2bfa-144a-4750-a22f-efb52ed0bc9b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b', 'volume_size': 2, 'source_volid': 'cc1b5a4c-ade1-402d-aab3-c956b2474250', 'source_volstatus': 'available'}
Jul 06 13:19:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:43 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a 1G" returned: 0 in 1.697s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:43 devstack sudo[91275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a
Jul 06 13:19:43 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:44 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a" returned: 0 in 1.191s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:44 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:19:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:44 devstack sudo[91282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a
Jul 06 13:19:44 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:45 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a" returned: 0 in 1.062s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:46 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info
Jul 06 13:19:46 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:47 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info" returned: 0 in 1.198s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:47 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:19:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:47 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info
Jul 06 13:19:47 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:48 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.info" returned: 0 in 1.432s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.041s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Creating offline snapshot e1c5eedd-b5c8-466c-87a1-d152f28ba133 of volume db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246afb4-bc2a-4953-9ebb-bea26c55dd30]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:48 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656
Jul 06 13:19:48 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:49 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656" returned: 0 in 1.250s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:50 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 1G
Jul 06 13:19:50 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:51 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 1G" returned: 0 in 1.156s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3f3b-ff93-432b-867b-067f9fb76656 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:51 devstack sudo[91309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3f3b-ff93-432b-867b-067f9fb76656 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133
Jul 06 13:19:51 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:51 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db1a3f3b-ff93-432b-867b-067f9fb76656 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133" returned: 0 in 0.827s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:51 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:19:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:52 devstack sudo[91322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133
Jul 06 13:19:52 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:52 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133" returned: 0 in 0.913s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:52 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=88,cinder:INSERT=22,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:19:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:52 devstack sudo[91327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info
Jul 06 13:19:52 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:53 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:53 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:19:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:53 devstack sudo[91358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info
Jul 06 13:19:53 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:54 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.info" returned: 0 in 0.910s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.038s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.985s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:19:54 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Cloning volume cc1b5a4c-ade1-402d-aab3-c956b2474250 to volume 892f2bfa-144a-4750-a22f-efb52ed0bc9b
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Creating offline snapshot 2e7fb394-317a-4722-8da8-3802f144a50a of volume cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc128ca7-daf8-40b0-8a0a-feeb74e2d477]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b7e8bfbb-d808-444b-afd8-cee14f85bc99 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: created successfully
Jul 06 13:19:54 devstack sudo[91377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:19:54 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:56 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.258s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:56 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a 1G
Jul 06 13:19:56 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: deleting
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: deleting {{(pid=86698) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-7794e81e-605a-4b05-bfea-c4c46f12af1a" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-7794e81e-605a-4b05-bfea-c4c46f12af1a" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Deleting offline snapshot 7794e81e-605a-4b05-bfea-c4c46f12af1a of volume 1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] snapshot_file for this snap is: volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a3fb3-cbaf-4dba-bae0-65929256f29c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:56 devstack sudo[91406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a
Jul 06 13:19:56 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:57 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a 1G" returned: 0 in 1.542s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:57 devstack sudo[91417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:19:57 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:57 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a" returned: 0 in 1.368s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ec40bf-05db-4ccc-9e75-49cc173347cb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:19:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:58 devstack sudo[91453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97
Jul 06 13:19:58 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:59 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 1.393s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:59 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a is being set with open permissions: ugo+rw
Jul 06 13:19:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:59 devstack sudo[91461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:19:59 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:19:59 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root
Jul 06 13:19:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" returned: 0 in 1.625s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:19:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:19:59 devstack sudo[91466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a
Jul 06 13:19:59 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:00 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 1.285s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=92,cinder:SELECT=87,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:00 devstack sudo[91469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info
Jul 06 13:20:00 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Flow 'volume_create_manager' (b4e4db50-2718-46f2-ace5-bae5128f8c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b187b2-4fc4-45a7-932b-7b7864f611a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b187b2-4fc4-45a7-932b-7b7864f611a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1511087751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7442a2-547a-4227-8a30-a87edbb83844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ac67f460c348e487a0f9d22436f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:00Z,use_quota=True,user_id='00d5955b3c3b4dbe834a1b2f6af301eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf45745-59c4-4ded-af77-141a82eb1018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf45745-59c4-4ded-af77-141a82eb1018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ac3af2-5560-44b5-a7a1-9f78f8727def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ac3af2-5560-44b5-a7a1-9f78f8727def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7442a2-547a-4227-8a30-a87edbb83844', 'volume_name': 'volume-5c7442a2-547a-4227-8a30-a87edbb83844', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861bd797-4f67-467c-9f9b-f33105870523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861bd797-4f67-467c-9f9b-f33105870523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7ce79-6424-4381-868c-21ddda3b26d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Volume 5c7442a2-547a-4227-8a30-a87edbb83844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7442a2-547a-4227-8a30-a87edbb83844', 'volume_size': 1}
Jul 06 13:20:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:01 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a" returned: 0 in 1.506s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:01 devstack sudo[91474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a
Jul 06 13:20:01 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:01 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info" returned: 0 in 1.212s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:01 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info is being set with open permissions: ugo+rw
Jul 06 13:20:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:01 devstack sudo[91477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info
Jul 06 13:20:01 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:02 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97.7794e81e-605a-4b05-bfea-c4c46f12af1a" returned: 0 in 1.597s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-7794e81e-605a-4b05-bfea-c4c46f12af1a" released by "_delete_snapshot" :: held 6.337s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" released by "delete_snapshot" :: held 6.401s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:02 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.info" returned: 0 in 1.272s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-e1c5eedd-b5c8-466c-87a1-d152f28ba133" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] snapshot: 2e7fb394-317a-4722-8da8-3802f144a50a, volume: 892f2bfa-144a-4750-a22f-efb52ed0bc9b,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-e1c5eedd-b5c8-466c-87a1-d152f28ba133" acquired by "_delete_snapshot" :: waited 0.087s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Deleting offline snapshot e1c5eedd-b5c8-466c-87a1-d152f28ba133 of volume db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:20:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] snapshot_file for this snap is: volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:20:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1899e5-b312-462d-bd1f-a077fa5b49da]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cde9327-27b2-4345-a433-64b3ab5a7b30]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:03 devstack sudo[91482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:20:03 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:03 devstack sudo[91483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133
Jul 06 13:20:03 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 1.231s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc1b5a4c-ade1-402d-aab3-c956b2474250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:20:04 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c459509-bdf9-4827-a657-8657a36ca451]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:04 devstack sudo[91492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:20:04 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:04 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133" returned: 0 in 1.523s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db1a3f3b-ff93-432b-867b-067f9fb76656(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b28541e-0f7b-4330-8aa5-be273ae36e75]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:05 devstack sudo[91495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656
Jul 06 13:20:05 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:05 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.585s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:05 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:20:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:05 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b
Jul 06 13:20:05 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:06 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656" returned: 0 in 1.691s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:06 devstack sudo[91506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133
Jul 06 13:20:06 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:07 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133" returned: 0 in 1.606s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:07 devstack sudo[91524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133
Jul 06 13:20:08 devstack sudo[91524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:09 devstack sudo[91524]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656.e1c5eedd-b5c8-466c-87a1-d152f28ba133" returned: 0 in 1.659s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-e1c5eedd-b5c8-466c-87a1-d152f28ba133" released by "_delete_snapshot" :: held 6.723s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" released by "delete_snapshot" :: held 6.825s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:09 devstack cinder-volume[86698]: WARNING cinder.quota [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-499621728 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-499621728, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:09 devstack cinder-volume[86698]: WARNING cinder.quota [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-499621728 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-499621728, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['85616533-073e-4c08-8ed0-2e95f00bc153', '6042bd6f-f4d2-4cdb-b566-43e7abafd1f4', '559f0902-cdc6-44be-9c4b-31616f604166', 'c2d97fa8-f03e-4407-9b8e-721e87dd4d24'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['09021550-d6c7-486d-bf9b-efd84d8501ee', '3aa794d4-6b39-482e-9df3-75870b40dd4e', 'fd376421-1cbc-41c3-ba69-7b50de5150b1', '6ad9ea61-21cd-469f-9ddd-2872db8dff3c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-72994ff1-7aee-4d33-81c2-9dcbaaba58b1 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 80d966f7-ae2e-44e0-800f-3f77d31b08d4: deleted successfully
Jul 06 13:20:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" acquired by "delete_volume" :: waited 0.056s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bcc2f3-fed7-4746-b3d3-21b481b1bdfa]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:13 devstack sudo[91549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97
Jul 06 13:20:13 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:13 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b" returned: 0 in 8.012s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[937640c7-3915-491b-8527-5fbbc41e2c6d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:14 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:20:14 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:14 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" returned: 0 in 1.424s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:14 devstack sudo[91556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97
Jul 06 13:20:14 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:15 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.118s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:20:15 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Converted 1024.00 MB image at 127.77 MB/s
Jul 06 13:20:15 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b is being set with open permissions: ugo+rw
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:15 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:15 devstack sudo[91562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b
Jul 06 13:20:15 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-1ca7a2d2-b394-49bc-9275-8c0bd82aad97" released by "delete_volume" :: held 2.474s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6bc17e-34df-44b8-a055-03838877066e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:15 devstack sudo[91564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656
Jul 06 13:20:15 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:15 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b" returned: 0 in 0.873s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" released by "_copy_volume_from_snapshot" :: held 13.022s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-quobyte-2e7fb394-317a-4722-8da8-3802f144a50a" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-2e7fb394-317a-4722-8da8-3802f144a50a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Deleting offline snapshot 2e7fb394-317a-4722-8da8-3802f144a50a of volume cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:20:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] snapshot_file for this snap is: volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:20:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d6a3e8-f70a-499d-a505-20a8c93b7590]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:16 devstack sudo[91572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:20:16 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:16 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656" returned: 0 in 1.066s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:16 devstack sudo[91578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656
Jul 06 13:20:16 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:17 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-db1a3f3b-ff93-432b-867b-067f9fb76656" returned: 0 in 0.786s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:17 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 1.000s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc1b5a4c-ade1-402d-aab3-c956b2474250(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-db1a3f3b-ff93-432b-867b-067f9fb76656" released by "delete_volume" :: held 1.931s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ba506-ba91-4e41-9b36-1332b67b6983]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['efa98118-0270-4442-a192-810b54f6052c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:17 devstack cinder-volume[86698]: WARNING cinder.quota [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-499621728 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-499621728, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:17 devstack sudo[91592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:20:17 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['a7a6f625-1415-42c3-aa22-fe00b047fed1', 'f86dc27c-ac89-4fe5-b1ef-f214ed73137c', 'f1969c50-0e58-468e-b26b-872eb289dac5', '50891551-cedb-45fb-b26a-dc8a0085974a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['fe64fd29-f486-4795-bbe2-525ce4c82132', 'f4594775-2549-48d3-8185-abd4122f874f', 'a28ed37f-e93d-4568-9f73-646182e7fe99', '31e47331-a50e-472c-a4ea-e462d6fc06f0'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:17 devstack sudo[91594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:17 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:18 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.055s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:18 devstack sudo[91599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:20:18 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:18 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1dab9703-ac4a-45b2-9fcc-9e290a333a70 tempest-GroupSnapshotsTest-13427710 None] Delete group completed successfully.
Jul 06 13:20:18 devstack sudo[91602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:18 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7757222c-2eb5-434a-b001-87cc0781fa6d tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-1971032112: creating
Jul 06 13:20:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7757222c-2eb5-434a-b001-87cc0781fa6d tempest-GroupSnapshotsTest-13427710 None] Group tempest-GroupSnapshotsTest-Group-1971032112: created successfully
Jul 06 13:20:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7757222c-2eb5-434a-b001-87cc0781fa6d tempest-GroupSnapshotsTest-13427710 None] Create group completed successfully.
Jul 06 13:20:19 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 1.036s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:19 devstack sudo[91608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a
Jul 06 13:20:19 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:19 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.072s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 8 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:20:19 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250.2e7fb394-317a-4722-8da8-3802f144a50a" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-2e7fb394-317a-4722-8da8-3802f144a50a" released by "_delete_snapshot" :: held 3.957s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.261s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.263s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1511087751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7442a2-547a-4227-8a30-a87edbb83844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18ac67f460c348e487a0f9d22436f04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:00Z,use_quota=True,user_id='00d5955b3c3b4dbe834a1b2f6af301eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Creating volume 5c7442a2-547a-4227-8a30-a87edbb83844 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:20:20 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f8b46c-65aa-4d91-b2a2-2662b7ca8510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b', 'volume_size': 2, 'source_volid': 'cc1b5a4c-ade1-402d-aab3-c956b2474250', 'source_volstatus': 'available'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a564f851-2606-4666-85f4-27633d25b5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:20 devstack sudo[91612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 1073741824
Jul 06 13:20:20 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Volume volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b (892f2bfa-144a-4750-a22f-efb52ed0bc9b): created successfully
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a564f851-2606-4666-85f4-27633d25b5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Flow 'volume_create_manager' (e2119f97-0044-4598-9192-e5e9e7fad662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0b47bd75-4aa5-4d91-ac4d-ceba19911d9e tempest-VolumesCloneTest-504575888 None] Created volume successfully.
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-892f2bfa-144a-4750-a22f-efb52ed0bc9b-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "cinder-892f2bfa-144a-4750-a22f-efb52ed0bc9b-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (d95e8927-f111-4f41-a8ee-a382581efe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f312a5-ddaf-4f79-95a1-103507aa6f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f312a5-ddaf-4f79-95a1-103507aa6f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155389831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8e4730c-6085-487d-9c9a-aafe2e537a8c,host='devstack@QuobyteHD#QuobyteHD',id=0e04ff21-2ecf-411a-96ff-ec10dd14d7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:21Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df45f76a-9a6a-451f-89ab-3d9612cdacda),volume_type_id=df45f76a-9a6a-451f-89ab-3d9612cdacda)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b75dd5-ecd3-4897-a556-5f6f660928df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b75dd5-ecd3-4897-a556-5f6f660928df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5920a0-b0ef-4a48-aafc-6a824119f9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5920a0-b0ef-4a48-aafc-6a824119f9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e04ff21-2ecf-411a-96ff-ec10dd14d7f1', 'volume_name': 'volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39920387-cb62-4e5a-a264-5c520e1cb7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39920387-cb62-4e5a-a264-5c520e1cb7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0547b9c-f4ab-484f-a62c-252d3ea49d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Volume 0e04ff21-2ecf-411a-96ff-ec10dd14d7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1', 'volume_size': 1}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:21 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 1073741824" returned: 0 in 1.395s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2388d4c7-5b13-491a-908a-56cbf8707ae3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:21 devstack sudo[91619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844
Jul 06 13:20:21 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:21 devstack sudo[91618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b
Jul 06 13:20:21 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:22 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844" returned: 0 in 1.126s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] <== create_volume: return (2611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.229s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d8e4730c-6085-487d-9c9a-aafe2e537a8c,created_at=2026-07-06T11:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1155389831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d8e4730c-6085-487d-9c9a-aafe2e537a8c,host='devstack@QuobyteHD#QuobyteHD',id=0e04ff21-2ecf-411a-96ff-ec10dd14d7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651296c1e4f94941a66b8f225011cbaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:21Z,use_quota=True,user_id='e1491f11562e44f2b63ebbd9c93305eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df45f76a-9a6a-451f-89ab-3d9612cdacda),volume_type_id=df45f76a-9a6a-451f-89ab-3d9612cdacda)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Creating volume 0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:20:22 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7ce79-6424-4381-868c-21ddda3b26d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7442a2-547a-4227-8a30-a87edbb83844', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88fd702-704d-4772-b619-435dd4ce2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:22 devstack sudo[91627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 1073741824
Jul 06 13:20:22 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Volume volume-5c7442a2-547a-4227-8a30-a87edbb83844 (5c7442a2-547a-4227-8a30-a87edbb83844): created successfully
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88fd702-704d-4772-b619-435dd4ce2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Flow 'volume_create_manager' (b4e4db50-2718-46f2-ace5-bae5128f8c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8ab1c518-c9c7-4b1a-ba32-d3015d6abf53 tempest-ServerRescueNegativeTestJSON-1448513389 None] Created volume successfully.
Jul 06 13:20:22 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b" returned: 0 in 1.263s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:22 devstack sudo[91630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b
Jul 06 13:20:22 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:23 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-892f2bfa-144a-4750-a22f-efb52ed0bc9b" returned: 0 in 0.888s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-892f2bfa-144a-4750-a22f-efb52ed0bc9b" released by "delete_volume" :: held 2.218s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Created reservations ['8dc53654-7a52-415c-8992-1efd774f32ee', '0938927c-37be-4bf8-ae34-7c4165fc3715', 'a9e4e2a6-80f6-4ea6-845d-5e274d821ecf', '74cf6262-1e5c-4822-b484-a3169de66311'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:23 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 1073741824" returned: 0 in 1.352s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:24 devstack sudo[91655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:24 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:24 devstack sudo[91657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1
Jul 06 13:20:24 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:24 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" returned: 0 in 0.750s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-cc1b5a4c-ade1-402d-aab3-c956b2474250-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0547b9c-f4ab-484f-a62c-252d3ea49d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2a9c42-f5ee-416f-b06e-64f201bcc8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "cinder-cc1b5a4c-ade1-402d-aab3-c956b2474250-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:24 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Volume volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 (0e04ff21-2ecf-411a-96ff-ec10dd14d7f1): created successfully
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2a9c42-f5ee-416f-b06e-64f201bcc8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Flow 'volume_create_manager' (d95e8927-f111-4f41-a8ee-a382581efe0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:24 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.932s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Deleted volume successfully.
Jul 06 13:20:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-161f75f7-6832-4251-a3c4-782893d69226 tempest-GroupSnapshotsTest-13427710 None] Created volume successfully.
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Acquiring lock "cinder-quobyte-cc1b5a4c-ade1-402d-aab3-c956b2474250" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0804eab2-31fa-4cee-8cc7-0e309a2b47e6 tempest-VolumesCloneTest-504575888 None] Lock "cinder-892f2bfa-144a-4750-a22f-efb52ed0bc9b-delete_volume" released by "delete_volume" :: held 3.771s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-cc1b5a4c-ade1-402d-aab3-c956b2474250" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4797820-4ade-47c9-840a-bcf160bb0d1b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:25 devstack sudo[91662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:20:25 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] GroupSnapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: creating.
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Group snapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: creating. {{(pid=86698) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Creating offline snapshot 5cba8d90-3638-4d7b-8dd9-795e9c6feb89 of volume 0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[33586823-9288-4f84-85e6-b6e3ebe275f8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:25 devstack sudo[91664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1
Jul 06 13:20:25 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:26 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 1.266s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:26 devstack sudo[91669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250
Jul 06 13:20:26 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:26 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" returned: 0 in 0.885s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:26 devstack sudo[91675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 1G
Jul 06 13:20:26 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:27 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc1b5a4c-ade1-402d-aab3-c956b2474250" returned: 0 in 0.742s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "cinder-quobyte-cc1b5a4c-ade1-402d-aab3-c956b2474250" released by "delete_volume" :: held 2.124s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Created reservations ['a590a14c-2d95-4f16-889c-076699dd0dcf', '4c9897f2-0dfc-463f-9849-e1267223f6f3', '326b8360-5579-4452-aa0e-9896e5704c6f', '890ff8e2-1065-4a7a-a6ce-ef9727f5ec17'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:27 devstack sudo[91678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:27 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:27 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 1G" returned: 0 in 0.960s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:27 devstack sudo[91683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89
Jul 06 13:20:27 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:28 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.019s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:28 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Deleted volume successfully.
Jul 06 13:20:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8c327db3-f040-4efd-8a8b-866f8833d2f7 tempest-VolumesCloneTest-504575888 None] Lock "cinder-cc1b5a4c-ade1-402d-aab3-c956b2474250-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:28 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89" returned: 0 in 1.204s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:28 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:20:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:28 devstack sudo[91740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89
Jul 06 13:20:28 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:29 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89" returned: 0 in 0.834s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:29 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info
Jul 06 13:20:29 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:30 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:30 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:20:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:30 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info
Jul 06 13:20:30 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:31 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.info" returned: 0 in 1.021s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.856s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-47fdfc2a-3c46-4a82-a9dc-9dc7abb014fc tempest-GroupSnapshotsTest-13427710 None] group_snapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: created successfully
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (8e6b6169-8d28-4a55-a378-d9c46231fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844ae86a-6722-4072-854c-aaf9223f41d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844ae86a-6722-4072-854c-aaf9223f41d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-149735571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfccc4d-cd53-40f2-9f08-2aa64e893120,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:32Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904938fb-6e8f-421c-a7d9-38e2a2a2d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904938fb-6e8f-421c-a7d9-38e2a2a2d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28282a1-5474-43aa-8170-da63534c3eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28282a1-5474-43aa-8170-da63534c3eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfccc4d-cd53-40f2-9f08-2aa64e893120', 'volume_name': 'volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191decf7-ad51-497d-a3de-cc4fa3b5a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191decf7-ad51-497d-a3de-cc4fa3b5a531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9331e0-7deb-4408-a83c-7c282b650844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Volume 9dfccc4d-cd53-40f2-9f08-2aa64e893120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120', 'volume_size': 1}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-149735571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfccc4d-cd53-40f2-9f08-2aa64e893120,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:32Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Creating volume 9dfccc4d-cd53-40f2-9f08-2aa64e893120 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:20:32 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: deleting
Jul 06 13:20:32 devstack sudo[91787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 1073741824
Jul 06 13:20:32 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: deleting {{(pid=86698) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-5cba8d90-3638-4d7b-8dd9-795e9c6feb89" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-5cba8d90-3638-4d7b-8dd9-795e9c6feb89" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Deleting offline snapshot 5cba8d90-3638-4d7b-8dd9-795e9c6feb89 of volume 0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] snapshot_file for this snap is: volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[75386ec1-2e61-4911-843a-f4f9d98b1bcc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:33 devstack sudo[91789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89
Jul 06 13:20:33 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:34 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89" returned: 0 in 1.178s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56147ce-cec3-428b-8c0f-02ed756b585f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:34 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 1073741824" returned: 0 in 1.592s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:34 devstack sudo[91821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1
Jul 06 13:20:34 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:34 devstack sudo[91822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120
Jul 06 13:20:34 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:35 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120" returned: 0 in 1.263s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] <== create_volume: return (2945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.957s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9331e0-7deb-4408-a83c-7c282b650844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec405db6-8151-4d8c-8a66-a4d489ce0218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:35 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Volume volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 (9dfccc4d-cd53-40f2-9f08-2aa64e893120): created successfully
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec405db6-8151-4d8c-8a66-a4d489ce0218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (8e6b6169-8d28-4a55-a378-d9c46231fb30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4f05dc74-0af5-47cc-ba1f-784ddf6b5b36 tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:20:36 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" returned: 0 in 2.160s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:36 devstack sudo[91831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89
Jul 06 13:20:36 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:38 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89" returned: 0 in 1.841s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:38 devstack sudo[91837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89
Jul 06 13:20:38 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (793854b5-6282-4822-b7fb-4dc4f323de0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33384a5a-5fb7-4290-accd-06b1c1f97334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33384a5a-5fb7-4290-accd-06b1c1f97334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2131582747',display_name='tempest-VolumesGetTest-Volume-2144059575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33aedd3-9621-4c29-9097-740f2c8c1489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:39Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65dfaf9-c7b5-48f0-ae91-5396cbb825c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65dfaf9-c7b5-48f0-ae91-5396cbb825c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2499e4b1-acbe-4160-9ad7-8347de01ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2499e4b1-acbe-4160-9ad7-8347de01ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33aedd3-9621-4c29-9097-740f2c8c1489', 'volume_name': 'volume-c33aedd3-9621-4c29-9097-740f2c8c1489', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383d1fa-9f87-4e4b-a676-76179860062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383d1fa-9f87-4e4b-a676-76179860062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d34359-4328-4335-b250-550b4262e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Volume c33aedd3-9621-4c29-9097-740f2c8c1489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33aedd3-9621-4c29-9097-740f2c8c1489', 'volume_size': 1}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2131582747',display_name='tempest-VolumesGetTest-Volume-2144059575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33aedd3-9621-4c29-9097-740f2c8c1489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:39Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Creating volume c33aedd3-9621-4c29-9097-740f2c8c1489 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:20:39 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:39 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 1073741824
Jul 06 13:20:39 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:39 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1.5cba8d90-3638-4d7b-8dd9-795e9c6feb89" returned: 0 in 1.881s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-5cba8d90-3638-4d7b-8dd9-795e9c6feb89" released by "_delete_snapshot" :: held 7.287s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" released by "delete_snapshot" :: held 7.356s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:40 devstack cinder-volume[86698]: WARNING cinder.quota [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1189178224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1189178224, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:40 devstack cinder-volume[86698]: WARNING cinder.quota [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1189178224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1189178224, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:40 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] Created reservations ['9bba6353-10c5-489d-902f-d4817eb1da8b', 'bb130600-0b15-4ab4-9b4c-4c8c01b7d142', 'a67275a9-ca79-4bf6-b71f-5bf0bff46120', '6f873706-90ca-4ea3-851c-1b52aa5c7583'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9b6055a8-6ea0-4dc8-ac7e-724db9596ed3 tempest-GroupSnapshotsTest-13427710 None] group_snapshot 3fbbf47c-5aa9-4a6b-a36c-3bd5308647bc: deleted successfully
Jul 06 13:20:41 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 1073741824" returned: 0 in 2.004s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:41 devstack sudo[91848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489
Jul 06 13:20:41 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" acquired by "delete_volume" :: waited 0.074s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b54e16-c1cc-40e7-8614-f9d4fcd472ef]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:41 devstack sudo[91851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1
Jul 06 13:20:41 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:42 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489" returned: 0 in 0.852s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d34359-4328-4335-b250-550b4262e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33aedd3-9621-4c29-9097-740f2c8c1489', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ab057-9238-4ee3-ba28-8084318b0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Volume volume-c33aedd3-9621-4c29-9097-740f2c8c1489 (c33aedd3-9621-4c29-9097-740f2c8c1489): created successfully
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (840ab057-9238-4ee3-ba28-8084318b0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (793854b5-6282-4822-b7fb-4dc4f323de0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6c6acb44-d9b1-4a38-a9c1-878698ef5ac2 tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:20:42 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" returned: 0 in 0.999s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:42 devstack sudo[91884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1
Jul 06 13:20:42 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:43 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" returned: 0 in 0.708s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Lock "cinder-quobyte-0e04ff21-2ecf-411a-96ff-ec10dd14d7f1" released by "delete_volume" :: held 1.857s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Created reservations ['d8bf7d2b-1a00-4e6c-9713-bafa8e3ec1cb'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:43 devstack cinder-volume[86698]: WARNING cinder.quota [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1189178224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1189178224, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Created reservations ['af1dcf4c-8364-4704-a2d8-fa145dcafe89', '68990c74-14d3-4de4-a5f4-1ce573640a5a', 'f5b43949-2b46-45f1-b58f-258ad058cc8b', 'de2712de-6d9a-4aae-9537-a8bac5ff81ef'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-c33aedd3-9621-4c29-9097-740f2c8c1489-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "cinder-c33aedd3-9621-4c29-9097-740f2c8c1489-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-c33aedd3-9621-4c29-9097-740f2c8c1489" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-c33aedd3-9621-4c29-9097-740f2c8c1489" acquired by "delete_volume" :: waited 0.063s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbae718f-3a6d-42d5-beef-ba05eb24dd0c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:43 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:43 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:44 devstack sudo[91888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489
Jul 06 13:20:44 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:45 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.233s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:45 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b9f9d65f-6bb1-4017-ae0b-907d3a53024c tempest-GroupSnapshotsTest-13427710 None] Delete group completed successfully.
Jul 06 13:20:45 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489" returned: 0 in 1.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:45 devstack sudo[91954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489
Jul 06 13:20:45 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Acquiring lock "cinder-5c7442a2-547a-4227-8a30-a87edbb83844-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "cinder-5c7442a2-547a-4227-8a30-a87edbb83844-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Acquiring lock "cinder-quobyte-5c7442a2-547a-4227-8a30-a87edbb83844" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "cinder-quobyte-5c7442a2-547a-4227-8a30-a87edbb83844" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e677bc-68b4-4ce6-8bfc-de4c08eb9912]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:46 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844
Jul 06 13:20:46 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:46 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c33aedd3-9621-4c29-9097-740f2c8c1489" returned: 0 in 1.368s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-c33aedd3-9621-4c29-9097-740f2c8c1489" released by "delete_volume" :: held 3.175s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Created reservations ['8b15310e-4173-4eeb-8e3d-84ab7a64ed4f', '9d4cc9ff-8bd7-4314-a905-b3dc30720fb6', '0e2e7eda-cca0-43ae-b148-bdba9d904140', 'd71d040f-1662-4aee-9b15-36a0133cfa64'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:47 devstack sudo[91961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:47 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:47 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844" returned: 0 in 1.423s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:47 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844
Jul 06 13:20:47 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:48 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.009s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-9dfccc4d-cd53-40f2-9f08-2aa64e893120-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c5247df8-ae8f-49c7-b2f0-c200cdd0a98c tempest-VolumesGetTest-887155387 None] Lock "cinder-c33aedd3-9621-4c29-9097-740f2c8c1489-delete_volume" released by "delete_volume" :: held 4.862s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "cinder-9dfccc4d-cd53-40f2-9f08-2aa64e893120-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-9dfccc4d-cd53-40f2-9f08-2aa64e893120" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-9dfccc4d-cd53-40f2-9f08-2aa64e893120" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[796c8e5e-e5ca-4915-be67-c0f5ba7ef00b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:48 devstack sudo[91967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120
Jul 06 13:20:48 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:48 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5c7442a2-547a-4227-8a30-a87edbb83844" returned: 0 in 1.198s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "cinder-quobyte-5c7442a2-547a-4227-8a30-a87edbb83844" released by "delete_volume" :: held 2.709s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Created reservations ['06ef69ff-eae3-456a-b5f1-38c72513f022', '66736a54-9be0-4063-b11c-75f03938fc39', '6ff46200-020d-4ed8-8a18-3afc59df5cd5', '040c577d-a15b-4ce6-951a-27734831a2f7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:49 devstack sudo[91970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:49 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:49 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120" returned: 0 in 1.229s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:49 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120
Jul 06 13:20:49 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:50 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.019s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Deleted volume successfully.
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-14b85fb3-d55d-4b24-b4bc-9c449bdd34cb tempest-ServerRescueNegativeTestJSON-1448513389 None] Lock "cinder-5c7442a2-547a-4227-8a30-a87edbb83844-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:50 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9dfccc4d-cd53-40f2-9f08-2aa64e893120" returned: 0 in 0.960s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-9dfccc4d-cd53-40f2-9f08-2aa64e893120" released by "delete_volume" :: held 2.259s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:50 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Created reservations ['cdce0a4e-5888-4387-8f84-d2d9603d8375', 'e6896cbd-fdae-4128-a86c-291250e0cd8f', '0616d4b2-8a67-4973-ba03-e332ec722406', '91af97dd-129a-4d99-a4b5-e020339da04f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:51 devstack sudo[91982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:20:51 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:52 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.038s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:20:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:20:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2b7e198c-ee16-4d0a-84f8-c48b9b73f31d tempest-VolumesGetTest-887155387 None] Lock "cinder-9dfccc4d-cd53-40f2-9f08-2aa64e893120-delete_volume" released by "delete_volume" :: held 3.679s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=109,cinder:SELECT=80,cinder:INSERT=33,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (cdfd8813-d217-4555-979b-990af4d4576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1879767f-52ad-4cdb-bd70-2c520d08265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1879767f-52ad-4cdb-bd70-2c520d08265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1332640687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a5685e-009e-4ed7-923f-46c987288337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:53Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0a0986-dde1-4fbe-9aac-3edde7733e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0a0986-dde1-4fbe-9aac-3edde7733e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c4fc7b-4e87-4451-ac73-9811921252b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c4fc7b-4e87-4451-ac73-9811921252b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a5685e-009e-4ed7-923f-46c987288337', 'volume_name': 'volume-28a5685e-009e-4ed7-923f-46c987288337', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd891c-e6ad-486c-81c1-dc25d7066dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cd891c-e6ad-486c-81c1-dc25d7066dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dc9e8d-8355-49db-9609-82980f1c328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Volume 28a5685e-009e-4ed7-923f-46c987288337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a5685e-009e-4ed7-923f-46c987288337', 'volume_size': 1}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1332640687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a5685e-009e-4ed7-923f-46c987288337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:53Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Creating volume 28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:20:53 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:20:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:53 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 1073741824
Jul 06 13:20:53 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:55 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 1073741824" returned: 0 in 1.674s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:55 devstack sudo[92037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:20:55 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:55 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 0.880s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] <== create_volume: return (2613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dc9e8d-8355-49db-9609-82980f1c328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a5685e-009e-4ed7-923f-46c987288337', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc57c80c-acca-4503-9ffe-541e7ef92619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:56 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Volume volume-28a5685e-009e-4ed7-923f-46c987288337 (28a5685e-009e-4ed7-923f-46c987288337): created successfully
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc57c80c-acca-4503-9ffe-541e7ef92619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (cdfd8813-d217-4555-979b-990af4d4576b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0627d8c1-ca52-465b-89e5-5f16e99f042b tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (8ee6069f-8564-489a-8941-dbfc64880e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615c5120-07c6-43d5-a878-3b17bd6a268b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615c5120-07c6-43d5-a878-3b17bd6a268b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1726846441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c65790-1aa4-437f-85bd-2dea473b0d32,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=28a5685e-009e-4ed7-923f-46c987288337,status='creating',terminated_at=None,updated_at=2026-07-06T11:20:57Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3dc86a-bf0b-4627-84e7-f6bb31c99d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3dc86a-bf0b-4627-84e7-f6bb31c99d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248d42ac-18e8-41b9-aac2-38f8ae3e0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248d42ac-18e8-41b9-aac2-38f8ae3e0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a2c65790-1aa4-437f-85bd-2dea473b0d32', 'volume_name': 'volume-a2c65790-1aa4-437f-85bd-2dea473b0d32', 'volume_size': 1, 'source_volid': '28a5685e-009e-4ed7-923f-46c987288337', 'source_volstatus': 'available'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586c6c5c-c3be-46a1-9e14-b75cf2ae7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586c6c5c-c3be-46a1-9e14-b75cf2ae7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6026e38e-2555-446e-bb1a-a221522125ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:57 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Volume a2c65790-1aa4-437f-85bd-2dea473b0d32: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a2c65790-1aa4-437f-85bd-2dea473b0d32', 'volume_size': 1, 'source_volid': '28a5685e-009e-4ed7-923f-46c987288337', 'source_volstatus': 'available'}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:20:57 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Cloning volume 28a5685e-009e-4ed7-923f-46c987288337 to volume a2c65790-1aa4-437f-85bd-2dea473b0d32
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Creating offline snapshot bbfbfe41-ca51-4b00-85aa-824520ba5306 of volume 28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09a1b2b-b7d5-43cc-94a1-967ce32d952c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:20:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:57 devstack sudo[92044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:20:57 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:58 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 0.987s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:58 devstack sudo[92049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 1G
Jul 06 13:20:58 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:20:59 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Flow 'volume_create_manager' (f5095ba0-43f3-46bc-835d-4b0d5726986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cb56df-46f3-424a-91c6-dbd1b37249e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 1G" returned: 0 in 1.321s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a5685e-009e-4ed7-923f-46c987288337 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:20:59 devstack sudo[92092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a5685e-009e-4ed7-923f-46c987288337 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:20:59 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88cb56df-46f3-424a-91c6-dbd1b37249e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-396624126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6879ee97-e227-43bf-8083-98a96307a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c57f688f78c44129358d2907879d069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:00Z,use_quota=True,user_id='b84b0d7934fc499cbd0558b9e6252350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ac2cec-1404-435b-a048-13d1f240b042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ac2cec-1404-435b-a048-13d1f240b042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2425be50-5794-41cf-881f-d4254109a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2425be50-5794-41cf-881f-d4254109a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6879ee97-e227-43bf-8083-98a96307a8b9', 'volume_name': 'volume-6879ee97-e227-43bf-8083-98a96307a8b9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:20:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8095d15b-1622-4b95-8799-ae7f9ae9a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8095d15b-1622-4b95-8799-ae7f9ae9a300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e304d-9480-4b34-8dd0-6b8abae514c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Volume 6879ee97-e227-43bf-8083-98a96307a8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6879ee97-e227-43bf-8083-98a96307a8b9', 'volume_size': 1}
Jul 06 13:21:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:00 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28a5685e-009e-4ed7-923f-46c987288337 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.870s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:00 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 is being set with open permissions: ugo+rw
Jul 06 13:21:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:00 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:21:00 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:01 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.878s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:01 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=95,cinder:UPDATE=113,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:21:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:01 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info
Jul 06 13:21:01 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:02 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info" returned: 0 in 0.751s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:02 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info is being set with open permissions: ugo+rw
Jul 06 13:21:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:02 devstack sudo[92129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info
Jul 06 13:21:02 devstack sudo[92129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-527d452c-81ba-4602-92b7-7e0ceb06676b tempest-GroupsTest-1257202312 None] Group tempest-Group1-1725113484: creating
Jul 06 13:21:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-527d452c-81ba-4602-92b7-7e0ceb06676b tempest-GroupsTest-1257202312 None] Group tempest-Group1-1725113484: created successfully
Jul 06 13:21:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-527d452c-81ba-4602-92b7-7e0ceb06676b tempest-GroupsTest-1257202312 None] Create group completed successfully.
Jul 06 13:21:03 devstack sudo[92129]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.info" returned: 0 in 0.772s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] snapshot: bbfbfe41-ca51-4b00-85aa-824520ba5306, volume: a2c65790-1aa4-437f-85bd-2dea473b0d32,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb65c34c-ea0a-419d-8b4b-79a1ddf0ea54]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:03 devstack sudo[92133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:21:03 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e0b977b6-a5c4-4876-a593-fbf2e173c137 tempest-GroupsTest-1257202312 None] Group tempest-Group2-1321829449: creating
Jul 06 13:21:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e0b977b6-a5c4-4876-a593-fbf2e173c137 tempest-GroupsTest-1257202312 None] Group tempest-Group2-1321829449: created successfully
Jul 06 13:21:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e0b977b6-a5c4-4876-a593-fbf2e173c137 tempest-GroupsTest-1257202312 None] Create group completed successfully.
Jul 06 13:21:04 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.807s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28a5685e-009e-4ed7-923f-46c987288337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[98191634-fd5a-4685-bdb4-8290840f86ae]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:04 devstack sudo[92139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:21:04 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:04 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 0.735s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:21:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:04 devstack sudo[92144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32
Jul 06 13:21:04 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (0a567321-64be-469e-8c04-f110da9358a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4914dd45-827e-475e-9d79-b129cc2e6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4914dd45-827e-475e-9d79-b129cc2e6b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069212847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a98e44e4-fe07-4b54-8cfd-49f2d2b9533b,host='devstack@QuobyteHD#QuobyteHD',id=648e5a53-c763-4a51-8d92-942b7c37bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:05Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f67248d-5e3d-44ff-99cd-79dcf8030de6),volume_type_id=9f67248d-5e3d-44ff-99cd-79dcf8030de6)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c70e54b-cf03-4112-8498-960c3a630348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c70e54b-cf03-4112-8498-960c3a630348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253aecb7-4f00-4df0-9576-612d43f25936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253aecb7-4f00-4df0-9576-612d43f25936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648e5a53-c763-4a51-8d92-942b7c37bef7', 'volume_name': 'volume-648e5a53-c763-4a51-8d92-942b7c37bef7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1844595f-aa2e-451a-b8e6-00eb020fbcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1844595f-aa2e-451a-b8e6-00eb020fbcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452356dc-2c70-4348-a002-11e50acd9915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Volume 648e5a53-c763-4a51-8d92-942b7c37bef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648e5a53-c763-4a51-8d92-942b7c37bef7', 'volume_size': 1}
Jul 06 13:21:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:09 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32" returned: 0 in 4.887s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c7343-59d9-488d-ab44-54c68d4d1e27]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:09 devstack sudo[92157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:21:09 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:10 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 1.031s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:10 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:21:10 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Converted 1024.00 MB image at 209.50 MB/s
Jul 06 13:21:10 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 is being set with open permissions: ugo+rw
Jul 06 13:21:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:10 devstack sudo[92163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32
Jul 06 13:21:10 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:11 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32" returned: 0 in 0.661s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" released by "_copy_volume_from_snapshot" :: held 8.192s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-bbfbfe41-ca51-4b00-85aa-824520ba5306" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-bbfbfe41-ca51-4b00-85aa-824520ba5306" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Deleting offline snapshot bbfbfe41-ca51-4b00-85aa-824520ba5306 of volume 28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] snapshot_file for this snap is: volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f7d8b-b0cf-44d3-a2f7-a6d5fa91ba0b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:11 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:21:11 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:12 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.904s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28a5685e-009e-4ed7-923f-46c987288337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:21:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5ae4e-5b61-413c-8b72-abf973f73c7d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:12 devstack sudo[92174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:21:12 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:13 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 0.867s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:13 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:21:13 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:14 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.833s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:14 devstack sudo[92185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306
Jul 06 13:21:14 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:14 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337.bbfbfe41-ca51-4b00-85aa-824520ba5306" returned: 0 in 0.722s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-bbfbfe41-ca51-4b00-85aa-824520ba5306" released by "_delete_snapshot" :: held 3.427s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.438s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.910s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-396624126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6879ee97-e227-43bf-8083-98a96307a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c57f688f78c44129358d2907879d069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:00Z,use_quota=True,user_id='b84b0d7934fc499cbd0558b9e6252350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Creating volume 6879ee97-e227-43bf-8083-98a96307a8b9 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:14 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6026e38e-2555-446e-bb1a-a221522125ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c65790-1aa4-437f-85bd-2dea473b0d32', 'volume_size': 1, 'source_volid': '28a5685e-009e-4ed7-923f-46c987288337', 'source_volstatus': 'available'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a090a3-5bf9-4e63-979a-2cc062c692f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:14 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 1073741824
Jul 06 13:21:14 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:15 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Volume volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 (a2c65790-1aa4-437f-85bd-2dea473b0d32): created successfully
Jul 06 13:21:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a090a3-5bf9-4e63-979a-2cc062c692f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (8ee6069f-8564-489a-8941-dbfc64880e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-daca436a-4ae6-460c-a80b-f39581812ec0 tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:21:15 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 1073741824" returned: 0 in 1.037s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:16 devstack sudo[92194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9
Jul 06 13:21:16 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (7b9c0f85-9096-4686-bec7-2a1e1f8750fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0c4d98-926d-472f-9c6e-7517b5d2d529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:16 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9" returned: 0 in 0.949s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.451s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a98e44e4-fe07-4b54-8cfd-49f2d2b9533b,created_at=2026-07-06T11:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2069212847',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a98e44e4-fe07-4b54-8cfd-49f2d2b9533b,host='devstack@QuobyteHD#QuobyteHD',id=648e5a53-c763-4a51-8d92-942b7c37bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:05Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f67248d-5e3d-44ff-99cd-79dcf8030de6),volume_type_id=9f67248d-5e3d-44ff-99cd-79dcf8030de6)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Creating volume 648e5a53-c763-4a51-8d92-942b7c37bef7 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:16 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0c4d98-926d-472f-9c6e-7517b5d2d529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-483360023',display_name='tempest-VolumesGetTest-Volume-348730944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cd5c5-b266-4017-8df1-aa629f6ba325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:17Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127af854-1811-4a93-ab22-90943363d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:17 devstack sudo[92204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 1073741824
Jul 06 13:21:17 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127af854-1811-4a93-ab22-90943363d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe88750-0989-49aa-a68c-36ee7abbf47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe88750-0989-49aa-a68c-36ee7abbf47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572cd5c5-b266-4017-8df1-aa629f6ba325', 'volume_name': 'volume-572cd5c5-b266-4017-8df1-aa629f6ba325', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589a0f5e-4850-4b92-9927-e833baeabf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589a0f5e-4850-4b92-9927-e833baeabf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59149a93-1a32-4e1b-83f0-6968354729c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:17 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Volume 572cd5c5-b266-4017-8df1-aa629f6ba325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572cd5c5-b266-4017-8df1-aa629f6ba325', 'volume_size': 1}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e304d-9480-4b34-8dd0-6b8abae514c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6879ee97-e227-43bf-8083-98a96307a8b9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff97a45e-f619-4301-a518-1cc79099db52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:17 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Volume volume-6879ee97-e227-43bf-8083-98a96307a8b9 (6879ee97-e227-43bf-8083-98a96307a8b9): created successfully
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff97a45e-f619-4301-a518-1cc79099db52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Flow 'volume_create_manager' (f5095ba0-43f3-46bc-835d-4b0d5726986f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e9541ac6-505b-4959-90d0-df7e4a6bbc55 tempest-AttachVolumeShelveTestJSON-90424769 None] Created volume successfully.
Jul 06 13:21:18 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 1073741824" returned: 0 in 1.067s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:18 devstack sudo[92215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7
Jul 06 13:21:18 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:18 devstack sudo[92217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:18 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:18 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7" returned: 0 in 0.744s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.808s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-483360023',display_name='tempest-VolumesGetTest-Volume-348730944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=572cd5c5-b266-4017-8df1-aa629f6ba325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:17Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Creating volume 572cd5c5-b266-4017-8df1-aa629f6ba325 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:18 devstack sudo[92222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 1073741824
Jul 06 13:21:18 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (452356dc-2c70-4348-a002-11e50acd9915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648e5a53-c763-4a51-8d92-942b7c37bef7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94880712-305e-4821-8a45-097d8344bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Volume volume-648e5a53-c763-4a51-8d92-942b7c37bef7 (648e5a53-c763-4a51-8d92-942b7c37bef7): created successfully
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94880712-305e-4821-8a45-097d8344bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (0a567321-64be-469e-8c04-f110da9358a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-41b06290-eae9-4198-adf4-268c7a38e1dd tempest-GroupsTest-1257202312 None] Created volume successfully.
Jul 06 13:21:19 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.975s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 8 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Acquiring lock "cinder-quobyte-648e5a53-c763-4a51-8d92-942b7c37bef7" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-648e5a53-c763-4a51-8d92-942b7c37bef7" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90e5453-40bb-45d9-9535-659d4728c5fc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:20 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 1073741824" returned: 0 in 1.211s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:20 devstack sudo[92228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7
Jul 06 13:21:20 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:20 devstack sudo[92230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325
Jul 06 13:21:20 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:20 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325" returned: 0 in 0.760s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59149a93-1a32-4e1b-83f0-6968354729c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572cd5c5-b266-4017-8df1-aa629f6ba325', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fc199d-a444-4b7a-941b-c4bc35f69210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7" returned: 0 in 0.942s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:20 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Volume volume-572cd5c5-b266-4017-8df1-aa629f6ba325 (572cd5c5-b266-4017-8df1-aa629f6ba325): created successfully
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0fc199d-a444-4b7a-941b-c4bc35f69210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (7b9c0f85-9096-4686-bec7-2a1e1f8750fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-719e0776-1fca-4c78-b52a-88e935130759 tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:21:21 devstack sudo[92242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7
Jul 06 13:21:21 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-572cd5c5-b266-4017-8df1-aa629f6ba325-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "cinder-572cd5c5-b266-4017-8df1-aa629f6ba325-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-572cd5c5-b266-4017-8df1-aa629f6ba325" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-572cd5c5-b266-4017-8df1-aa629f6ba325" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7225ed-cd0e-46d1-936a-e43bf3b3bfb5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:21 devstack sudo[92244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325
Jul 06 13:21:21 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:22 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-648e5a53-c763-4a51-8d92-942b7c37bef7" returned: 0 in 1.126s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-648e5a53-c763-4a51-8d92-942b7c37bef7" released by "delete_volume" :: held 2.139s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Created reservations ['93b67a89-a37c-44f6-9ebb-154c7fcbe1aa'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:22 devstack cinder-volume[86698]: WARNING cinder.quota [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-189223622 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-189223622, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:21:22 devstack cinder-volume[86698]: WARNING cinder.quota [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-189223622 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-189223622, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Created reservations ['629435e0-e1eb-4a7b-81e1-abb15ef34640', 'f20e2cd1-462b-44d2-855d-821d8d1bcb76', '817edbb0-4b3d-449c-a38a-43d54b8f1767', 'd571b1b5-fbda-4139-8dd6-66601b4d1299'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:22 devstack sudo[92249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:22 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:22 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325" returned: 0 in 1.114s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:22 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Created reservations ['f6eda272-c933-4a1e-81d2-82730b362986'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:22 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:22 devstack sudo[92260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:22 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:23 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.056s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-47da8fe3-82af-4045-8a3e-8877f5d9c8f5 tempest-GroupsTest-1257202312 None] Delete group completed successfully.
Jul 06 13:21:23 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.988s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-586b31de-0794-47d3-85da-dd17b0c2ff45 tempest-GroupsTest-1257202312 None] Delete group completed successfully.
Jul 06 13:21:23 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-572cd5c5-b266-4017-8df1-aa629f6ba325" returned: 0 in 1.204s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-572cd5c5-b266-4017-8df1-aa629f6ba325" released by "delete_volume" :: held 2.375s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Created reservations ['ca1fbce4-22b8-4a37-a868-fe69d3e89ea8', 'b7c752e7-3ad8-48a3-ba0a-e392172c800d', '98d82061-c9b5-44fa-b868-3399838a30f0', '22057536-f6ea-4198-ad38-30409cb4ce7e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:24 devstack sudo[92266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:24 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d75ab24c-5008-4607-887a-f1923f34ea57 tempest-GroupsTest-1257202312 None] Group tempest-GroupsTest-Group-1309755878: creating
Jul 06 13:21:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d75ab24c-5008-4607-887a-f1923f34ea57 tempest-GroupsTest-1257202312 None] Group tempest-GroupsTest-Group-1309755878: created successfully
Jul 06 13:21:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d75ab24c-5008-4607-887a-f1923f34ea57 tempest-GroupsTest-1257202312 None] Create group completed successfully.
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-a2c65790-1aa4-437f-85bd-2dea473b0d32-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "cinder-a2c65790-1aa4-437f-85bd-2dea473b0d32-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72fa232-6794-4b98-a022-d5ae92b8020e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:25 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32
Jul 06 13:21:25 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:25 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.182s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:21:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-98dcfc8f-9259-4469-9ec4-10fdddb37eb5 tempest-VolumesGetTest-887155387 None] Lock "cinder-572cd5c5-b266-4017-8df1-aa629f6ba325-delete_volume" released by "delete_volume" :: held 3.919s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:26 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32" returned: 0 in 0.952s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:26 devstack sudo[92274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32
Jul 06 13:21:26 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:27 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (01ed64ff-188b-4166-a892-816e07273cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318534f3-3c62-4ae4-916f-89f9aa6a715b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a2c65790-1aa4-437f-85bd-2dea473b0d32" returned: 0 in 0.975s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318534f3-3c62-4ae4-916f-89f9aa6a715b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754145722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c87e935-014b-461a-b515-5ce1cba18d25,host='devstack@QuobyteHD#QuobyteHD',id=0863bac4-38aa-48ed-8de7-c2f1ea1df4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:27Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbd31ce2-65f5-4bc7-add3-608ebc190088),volume_type_id=cbd31ce2-65f5-4bc7-add3-608ebc190088)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca70bbb-a578-4c6a-b454-db8d1013dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca70bbb-a578-4c6a-b454-db8d1013dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83757013-835c-4879-a0bc-18c79048c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83757013-835c-4879-a0bc-18c79048c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0863bac4-38aa-48ed-8de7-c2f1ea1df4b3', 'volume_name': 'volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade011b4-c3b9-43cd-8f08-fa7a03d17b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade011b4-c3b9-43cd-8f08-fa7a03d17b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e1b6a9-af0c-41fc-8fc8-94ebba882631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Volume 0863bac4-38aa-48ed-8de7-c2f1ea1df4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3', 'volume_size': 1}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5c87e935-014b-461a-b515-5ce1cba18d25,created_at=2026-07-06T11:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754145722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c87e935-014b-461a-b515-5ce1cba18d25,host='devstack@QuobyteHD#QuobyteHD',id=0863bac4-38aa-48ed-8de7-c2f1ea1df4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:27Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbd31ce2-65f5-4bc7-add3-608ebc190088),volume_type_id=cbd31ce2-65f5-4bc7-add3-608ebc190088)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Creating volume 0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:27 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-a2c65790-1aa4-437f-85bd-2dea473b0d32" released by "delete_volume" :: held 2.071s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:27 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 1073741824
Jul 06 13:21:27 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Created reservations ['afb24c45-2755-4751-867a-f35f9cd033cb', '036d9cf1-9143-47ba-87fc-59106e54067a', '8a53f457-6659-45cf-8ec4-b0e0fb1763e3', '03e78931-c3bf-4496-a661-a8afea4f9909'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:27 devstack sudo[92279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:27 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-28a5685e-009e-4ed7-923f-46c987288337-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "cinder-28a5685e-009e-4ed7-923f-46c987288337-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-28a5685e-009e-4ed7-923f-46c987288337" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-28a5685e-009e-4ed7-923f-46c987288337" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c072bc36-4617-4bb8-9c83-2839be6f6fff]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:28 devstack sudo[92281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:21:28 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:28 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.106s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:28 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:21:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7a920cdd-3463-46c6-babb-78e937bdd6c6 tempest-VolumesGetTest-887155387 None] Lock "cinder-a2c65790-1aa4-437f-85bd-2dea473b0d32-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:28 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 1073741824" returned: 0 in 1.519s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:28 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3
Jul 06 13:21:28 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:29 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 1.419s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:29 devstack sudo[92294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337
Jul 06 13:21:29 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:29 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" returned: 0 in 0.890s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e1b6a9-af0c-41fc-8fc8-94ebba882631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8584290-2247-4fd1-9468-32fd2338739a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Volume volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 (0863bac4-38aa-48ed-8de7-c2f1ea1df4b3): created successfully
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8584290-2247-4fd1-9468-32fd2338739a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (01ed64ff-188b-4166-a892-816e07273cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d9d30655-d7d0-4999-a345-71dfed808b40 tempest-GroupsTest-1257202312 None] Created volume successfully.
Jul 06 13:21:30 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-28a5685e-009e-4ed7-923f-46c987288337" returned: 0 in 0.848s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-28a5685e-009e-4ed7-923f-46c987288337" released by "delete_volume" :: held 2.379s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Created reservations ['eaee5dfa-0174-48f6-9620-179220d0e99d', '88f0e5ab-37c6-4749-ad60-0a6013f6f340', 'd917c406-b312-41ac-b44b-7f3db50e4ebd', '58240091-2897-47a0-bded-30cf963feb5a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:30 devstack sudo[92299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:30 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:31 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.891s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4f2dc25-37b6-41b6-a72c-a52e2f636b6e tempest-VolumesGetTest-887155387 None] Lock "cinder-28a5685e-009e-4ed7-923f-46c987288337-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (f78142d9-4285-47bd-9a70-6e171e3353d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc3633a-d9bb-4af3-ad60-a3cbbefd289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc3633a-d9bb-4af3-ad60-a3cbbefd289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37739467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c87e935-014b-461a-b515-5ce1cba18d25,host='devstack@QuobyteHD#QuobyteHD',id=ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:32Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbd31ce2-65f5-4bc7-add3-608ebc190088),volume_type_id=cbd31ce2-65f5-4bc7-add3-608ebc190088)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651afdfa-cf47-45db-9c65-6c52c97e6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (651afdfa-cf47-45db-9c65-6c52c97e6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a99d2ec-f1f4-4e5d-9207-72c40ea63954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a99d2ec-f1f4-4e5d-9207-72c40ea63954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6', 'volume_name': 'volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48c2af-b83e-4300-a5cd-03df59bdb8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c48c2af-b83e-4300-a5cd-03df59bdb8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d0e65e-f7d3-4b51-838f-c62be0f960d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:31 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Volume ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6', 'volume_size': 1}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5c87e935-014b-461a-b515-5ce1cba18d25,created_at=2026-07-06T11:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-37739467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5c87e935-014b-461a-b515-5ce1cba18d25,host='devstack@QuobyteHD#QuobyteHD',id=ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f334402f26e7445393b12089ddecac03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:32Z,use_quota=True,user_id='1b4e5bfd1d1f4d6ba35a44e831687f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cbd31ce2-65f5-4bc7-add3-608ebc190088),volume_type_id=cbd31ce2-65f5-4bc7-add3-608ebc190088)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Creating volume ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:32 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:32 devstack sudo[92305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 1073741824
Jul 06 13:21:32 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (32bb7747-7d17-408a-a20b-a850a89f7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3050ffeb-c7a1-4b3e-935d-4c20cad38d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3050ffeb-c7a1-4b3e-935d-4c20cad38d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1437371253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4a7e46-273c-4392-8c35-23ca7d5796b9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:33Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81c23dc-ba5d-40cc-ac94-5c06e3c03789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81c23dc-ba5d-40cc-ac94-5c06e3c03789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677b5f35-478e-40c9-809e-af1bda7e8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:32 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:21:33 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 1073741824" returned: 0 in 1.308s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:33 devstack sudo[92331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6
Jul 06 13:21:33 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677b5f35-478e-40c9-809e-af1bda7e8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f4a7e46-273c-4392-8c35-23ca7d5796b9', 'volume_name': 'volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235996a9400>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701a0587-c7f3-482b-a12c-3359733917de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701a0587-c7f3-482b-a12c-3359733917de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb5c99-a1a2-4f5d-b367-bce47983c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235996a9400>}
Jul 06 13:21:33 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Trying to clone 3f4a7e46-273c-4392-8c35-23ca7d5796b9 from image 5accfc22-7cac-4370-846d-07a9c8ee1607 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:21:34 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206244c-d5e3-4acf-9e06-8a5f48eedc43]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:34 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD
Jul 06 13:21:34 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:34 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" returned: 0 in 0.981s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d0e65e-f7d3-4b51-838f-c62be0f960d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffccb053-2f0b-45f4-989b-74db558215c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Volume volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 (ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6): created successfully
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffccb053-2f0b-45f4-989b-74db558215c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Flow 'volume_create_manager' (f78142d9-4285-47bd-9a70-6e171e3353d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-87d55463-4f21-4492-9006-1149952898db tempest-GroupsTest-1257202312 None] Created volume successfully.
Jul 06 13:21:35 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:35 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 is fetched for user 935d6e71bc614c9b818c8f3b66e84d7c. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:21:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d7e14-668d-4a44-af17-b8fe9d9e7146]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:35 devstack sudo[92362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD
Jul 06 13:21:35 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0d797065-2ab9-4447-aa07-e04ff992e932 tempest-GroupsTest-1257202312 None] Update group completed successfully.
Jul 06 13:21:36 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD" returned: 0 in 0.994s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1437371253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4a7e46-273c-4392-8c35-23ca7d5796b9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:33Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Creating volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:36 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:36 devstack sudo[92370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1073741824
Jul 06 13:21:36 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-1fbfe003-8997-4a25-8502-af31c35bf24a req-c49909f8-1132-44b0-bdf3-32a5cf60a1dd tempest-AttachVolumeShelveTestJSON-90424769 None] No connector for attachment 62a7d366-a339-4b6e-b500-b1c457b14a12; skipping storage backend terminate_connection call. {{(pid=86698) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 06 13:21:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-1fbfe003-8997-4a25-8502-af31c35bf24a req-c49909f8-1132-44b0-bdf3-32a5cf60a1dd tempest-AttachVolumeShelveTestJSON-90424769 None] Deleting attachment 62a7d366-a339-4b6e-b500-b1c457b14a12. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:21:37 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1073741824" returned: 0 in 0.916s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:37 devstack sudo[92377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:37 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-45164b35-6d9c-487f-b1b3-8429ff16af56 tempest-GroupsTest-1257202312 None] Update group completed successfully.
Jul 06 13:21:37 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Attempting download of 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690d8c1-13e5-4e7a-b5c0-c09605bda3e2]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:38 devstack sudo[92381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft
Jul 06 13:21:38 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:38 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft" returned: 0 in 0.769s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Acquiring lock "cinder-quobyte-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:38 devstack sudo[92387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft
Jul 06 13:21:38 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[603585c3-d2f3-462e-9ba3-68ab721c3dce]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:39 devstack sudo[92389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3
Jul 06 13:21:39 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:39 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft" returned: 1 in 0.836s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_e1f1paft' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedcd2b2-cbef-40a1-9c6d-29edade52c8b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:39 devstack sudo[92394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD
Jul 06 13:21:39 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:39 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" returned: 0 in 0.823s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:39 devstack sudo[92399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3
Jul 06 13:21:39 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:40 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] 5accfc22-7cac-4370-846d-07a9c8ee1607 was qcow2, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:40 devstack sudo[92405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:40 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:40 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-0863bac4-38aa-48ed-8de7-c2f1ea1df4b3" released by "delete_volume" :: held 1.662s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Acquiring lock "cinder-quobyte-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f6786-8712-4ff0-bad2-e55c2fea8302]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:40 devstack sudo[92407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6
Jul 06 13:21:40 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:41 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" returned: 0 in 1.080s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:41 devstack sudo[92422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6
Jul 06 13:21:41 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:42 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" returned: 0 in 1.078s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "cinder-quobyte-ffd8e2db-e4c0-4f3a-bb82-b582b39b4ea6" released by "delete_volume" :: held 2.214s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Created reservations ['66b8dd13-449a-4857-ad0c-a5c40d1d9645'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:42 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 0 in 2.605s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_fc7my3bqdevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:21:42 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Converted 112.00 MB image at 42.97 MB/s
Jul 06 13:21:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:43 devstack sudo[92430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1G
Jul 06 13:21:43 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:43 devstack cinder-volume[86698]: WARNING cinder.quota [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2076609212 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2076609212, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:21:43 devstack cinder-volume[86698]: WARNING cinder.quota [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2076609212 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2076609212, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Created reservations ['c5c65f83-dd83-4dfc-b152-2f015015c76e', '9a3927f5-c690-4342-a3ee-47e19d1b71ec', '66334593-1397-462f-aa63-6319c6c2eb8b', 'e352586d-a089-482f-a47d-d599b61d7e39'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Created reservations ['ecf602b6-5156-4c15-b5dd-03d4f29b707d', 'b65774fc-21e5-46a5-86aa-f6d6892d7787', '76c415e5-c7b9-4b94-a107-4d83f25a654f', '2f2518d0-d7c8-499a-96e1-9741f915fba1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:43 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:43 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:44 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 1G" returned: 0 in 1.097s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951973e-ddac-4333-8e0f-6c5f57f149d8]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:44 devstack sudo[92450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:44 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:44 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:44 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c51c7f72-cdff-4750-8154-17e2e86b6358 tempest-GroupsTest-1257202312 None] Delete group completed successfully.
Jul 06 13:21:45 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 0 in 0.906s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:45 devstack sudo[92455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:45 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 1 in 0.956s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Downloaded image 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9 successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:21:45 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 for user 935d6e71bc614c9b818c8f3b66e84d7c is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:21:45 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Marking volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9 as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Copying metadata from image 5accfc22-7cac-4370-846d-07a9c8ee1607 to 3f4a7e46-273c-4392-8c35-23ca7d5796b9. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Creating volume glance metadata for volume 3f4a7e46-273c-4392-8c35-23ca7d5796b9 backed by image 5accfc22-7cac-4370-846d-07a9c8ee1607 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8efb5c99-a1a2-4f5d-b367-bce47983c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235996a9400>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3045e9d4-2c0c-4f67-9bf1-d8c8a422cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Volume volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 (3f4a7e46-273c-4392-8c35-23ca7d5796b9): created successfully
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3045e9d4-2c0c-4f67-9bf1-d8c8a422cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (32bb7747-7d17-408a-a20b-a850a89f7a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-46c4c207-50f4-429a-899d-8ee1f4e0406e tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (f0a43706-1183-42b0-b87f-0819e5df4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701e8cf-0b62-4575-9828-e4e930825104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b701e8cf-0b62-4575-9828-e4e930825104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1654144038',display_name='tempest-VolumesGetTest-Volume-398043345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96a10db-ad79-4d8f-a4f4-f17b210b8b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:48Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee1c604-f32d-4494-829e-70e0a220842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee1c604-f32d-4494-829e-70e0a220842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eafaff6-c09f-4295-9e9d-bcc85a4c9e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eafaff6-c09f-4295-9e9d-bcc85a4c9e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96a10db-ad79-4d8f-a4f4-f17b210b8b78', 'volume_name': 'volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c9c3c7-bc05-4d1f-8757-23a459655be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c9c3c7-bc05-4d1f-8757-23a459655be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24280ef2-ba5b-4a83-bd09-35451877b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Volume b96a10db-ad79-4d8f-a4f4-f17b210b8b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78', 'volume_size': 1}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:21:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1654144038',display_name='tempest-VolumesGetTest-Volume-398043345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96a10db-ad79-4d8f-a4f4-f17b210b8b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8478f31ca8a3451d8638a4e7d155ce79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:21:48Z,use_quota=True,user_id='935d6e71bc614c9b818c8f3b66e84d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Creating volume b96a10db-ad79-4d8f-a4f4-f17b210b8b78 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:21:48 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:21:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:48 devstack sudo[92505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 1073741824
Jul 06 13:21:48 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:49 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 1073741824" returned: 0 in 1.538s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:50 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78
Jul 06 13:21:50 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:51 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" returned: 0 in 1.336s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] <== create_volume: return (2956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.961s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24280ef2-ba5b-4a83-bd09-35451877b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceaa81-0fb0-48be-94fe-64d8e7d5a891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:21:51 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Volume volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 (b96a10db-ad79-4d8f-a4f4-f17b210b8b78): created successfully
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cceaa81-0fb0-48be-94fe-64d8e7d5a891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:21:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Flow 'volume_create_manager' (f0a43706-1183-42b0-b87f-0819e5df4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:21:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-73f8f064-3027-4c2a-af0b-51cb676c1af5 tempest-VolumesGetTest-887155387 None] Created volume successfully.
Jul 06 13:21:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-02bc51bd-6e3d-40b8-ae1a-acf519c8376d tempest-GroupsV320Test-409664220 None] Group tempest-GroupsV320Test-Group-1977348134: creating
Jul 06 13:21:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-02bc51bd-6e3d-40b8-ae1a-acf519c8376d tempest-GroupsV320Test-409664220 None] Group tempest-GroupsV320Test-Group-1977348134: created successfully
Jul 06 13:21:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-02bc51bd-6e3d-40b8-ae1a-acf519c8376d tempest-GroupsV320Test-409664220 None] Create group completed successfully.
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-b96a10db-ad79-4d8f-a4f4-f17b210b8b78-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "cinder-b96a10db-ad79-4d8f-a4f4-f17b210b8b78-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4d393-831f-41dc-8b93-9b3455b1169b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:53 devstack sudo[92585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78
Jul 06 13:21:53 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=93,cinder:UPDATE=85,cinder:INSERT=27,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:21:54 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" returned: 0 in 1.540s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Created reservations ['0fbaf4ce-74cb-40c0-ae4d-c21430eb62ea'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:54 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78
Jul 06 13:21:54 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:54 devstack sudo[92592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:54 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:55 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" returned: 0 in 1.441s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-b96a10db-ad79-4d8f-a4f4-f17b210b8b78" released by "delete_volume" :: held 3.082s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Created reservations ['10d013e4-d9bd-438b-b718-f2c38fc3a39f', '5951af9d-7c0c-4200-87f9-acb710f6a2fe', '99540d03-09d7-4753-837d-7402f6b0f6d0', 'f17f626f-b173-4c9f-9ac4-3de27a3d6470'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:21:56 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.499s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-59c6ee25-ca83-4898-ad5e-03e3641aa6b6 tempest-GroupsV320Test-409664220 None] Delete group completed successfully.
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:56 devstack sudo[92598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:21:56 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-3f4a7e46-273c-4392-8c35-23ca7d5796b9-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "cinder-3f4a7e46-273c-4392-8c35-23ca7d5796b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Acquiring lock "cinder-quobyte-3f4a7e46-273c-4392-8c35-23ca7d5796b9" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-3f4a7e46-273c-4392-8c35-23ca7d5796b9" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1c76f1-2e43-49b3-9950-cabf9d62c308]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:21:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:57 devstack sudo[92600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:57 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:57 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.429s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:57 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:21:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:21:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c851c5a6-262e-4c29-9061-401a00430a59 tempest-VolumesGetTest-887155387 None] Lock "cinder-b96a10db-ad79-4d8f-a4f4-f17b210b8b78-delete_volume" released by "delete_volume" :: held 4.940s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:21:58 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 0 in 1.753s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:58 devstack sudo[92652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:58 devstack sudo[92652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:21:59 devstack sudo[92652]: pam_unix(sudo:session): session closed for user root
Jul 06 13:21:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 1 in 1.043s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:21:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:21:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:21:59 devstack sudo[92677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9
Jul 06 13:21:59 devstack sudo[92677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:00 devstack sudo[92677]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3f4a7e46-273c-4392-8c35-23ca7d5796b9" returned: 0 in 1.296s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "cinder-quobyte-3f4a7e46-273c-4392-8c35-23ca7d5796b9" released by "delete_volume" :: held 4.236s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Created reservations ['ef96135d-79c8-4a9b-abf2-a6d4b61556c5', '27762940-0ffd-4110-8ee4-785a99e9e72c', '30fc9211-0439-460d-b4e4-098a9e16b4eb', '0428567b-f21b-4ef9-93ef-53f1c471b125'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:01 devstack sudo[92716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:22:01 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:02 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.289s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:02 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:22:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Deleted volume successfully.
Jul 06 13:22:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-45103b27-eb5d-47a2-bda4-26a645d40074 tempest-VolumesGetTest-887155387 None] Lock "cinder-3f4a7e46-273c-4392-8c35-23ca7d5796b9-delete_volume" released by "delete_volume" :: held 6.051s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:05 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=87,cinder:UPDATE=110,cinder:INSERT=29,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Flow 'volume_create_manager' (8317f8a3-bb05-4fc0-ad88-139d8e756ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f255891-0f3b-49df-8f0b-a53479927273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f255891-0f3b-49df-8f0b-a53479927273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1925467696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa135606-e268-41bb-9f56-e97c9dfaab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e1646caf30417aba16eadf337e1946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:06Z,use_quota=True,user_id='b40cc256924440868a0688c2be552a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a051777-b45f-46dd-a74b-b769c21c61d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a051777-b45f-46dd-a74b-b769c21c61d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c779fcba-ea52-48d5-b0f0-ffbd2cfc9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c779fcba-ea52-48d5-b0f0-ffbd2cfc9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa135606-e268-41bb-9f56-e97c9dfaab89', 'volume_name': 'volume-fa135606-e268-41bb-9f56-e97c9dfaab89', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad77e1-660e-4554-ac4e-0a7cf7c02036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad77e1-660e-4554-ac4e-0a7cf7c02036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eb38ec-4892-43eb-aef1-fbadebb5d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Volume fa135606-e268-41bb-9f56-e97c9dfaab89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa135606-e268-41bb-9f56-e97c9dfaab89', 'volume_size': 1}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1925467696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa135606-e268-41bb-9f56-e97c9dfaab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e1646caf30417aba16eadf337e1946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:06Z,use_quota=True,user_id='b40cc256924440868a0688c2be552a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Creating volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:22:06 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:06 devstack sudo[92752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 1073741824
Jul 06 13:22:06 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Flow 'volume_create_manager' (4cc86205-6041-43bb-866a-f7ab2465486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3981abd4-7129-4693-9a05-45d25e81caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3981abd4-7129-4693-9a05-45d25e81caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-931324395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70072846-9253-4a1a-a983-5cceea7b9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed748d5f0084d9b98ac050f2de2b9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:06Z,use_quota=True,user_id='7244aee2a64342a1a28f886a7c72c025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cdfa38-8cab-4acb-9550-c9f85336e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cdfa38-8cab-4acb-9550-c9f85336e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d9e300-cb24-4bd9-92bf-9e97f4e30e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d9e300-cb24-4bd9-92bf-9e97f4e30e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70072846-9253-4a1a-a983-5cceea7b9168', 'volume_name': 'volume-70072846-9253-4a1a-a983-5cceea7b9168', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717eaf54-f64b-4aaa-9d14-54fa290a9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717eaf54-f64b-4aaa-9d14-54fa290a9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81fc07-041d-4bc9-8951-4e8151af7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Volume 70072846-9253-4a1a-a983-5cceea7b9168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70072846-9253-4a1a-a983-5cceea7b9168', 'volume_size': 1}
Jul 06 13:22:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:07 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 1073741824" returned: 0 in 0.906s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:07 devstack sudo[92758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89
Jul 06 13:22:07 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:07 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89" returned: 0 in 0.647s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-931324395',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70072846-9253-4a1a-a983-5cceea7b9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aed748d5f0084d9b98ac050f2de2b9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:06Z,use_quota=True,user_id='7244aee2a64342a1a28f886a7c72c025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Creating volume 70072846-9253-4a1a-a983-5cceea7b9168 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:22:07 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eb38ec-4892-43eb-aef1-fbadebb5d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa135606-e268-41bb-9f56-e97c9dfaab89', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbbf413-7851-482e-84c8-53eb97850512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:07 devstack sudo[92761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 1073741824
Jul 06 13:22:07 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Volume volume-fa135606-e268-41bb-9f56-e97c9dfaab89 (fa135606-e268-41bb-9f56-e97c9dfaab89): created successfully
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbbf413-7851-482e-84c8-53eb97850512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Flow 'volume_create_manager' (8317f8a3-bb05-4fc0-ad88-139d8e756ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0c461a75-f682-407e-bfb5-ae15be731c7c tempest-SnapshotsActionsTest-1019578610 None] Created volume successfully.
Jul 06 13:22:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:08 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 1073741824" returned: 0 in 0.896s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:08 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168
Jul 06 13:22:08 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:09 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168" returned: 0 in 0.669s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.004s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b81fc07-041d-4bc9-8951-4e8151af7011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70072846-9253-4a1a-a983-5cceea7b9168', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0c2586-385c-4951-82a0-072538aac39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Creating offline snapshot ecf857da-6371-4287-b000-6c9123fdd8d8 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Volume volume-70072846-9253-4a1a-a983-5cceea7b9168 (70072846-9253-4a1a-a983-5cceea7b9168): created successfully
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0c2586-385c-4951-82a0-072538aac39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Flow 'volume_create_manager' (4cc86205-6041-43bb-866a-f7ab2465486f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92aa20d-5fd1-4451-a093-944f6ca47dc7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0907f50c-972d-40d9-9393-0af5213a1c74 tempest-VolumesNegativeTest-8577847 None] Created volume successfully.
Jul 06 13:22:09 devstack sudo[92769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89
Jul 06 13:22:09 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:10 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89" returned: 0 in 0.751s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:10 devstack sudo[92774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 1G
Jul 06 13:22:10 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:11 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 1G" returned: 0 in 0.939s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:11 devstack sudo[92781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:11 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:11 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.880s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:12 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 is being set with open permissions: ugo+rw
Jul 06 13:22:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:12 devstack sudo[92790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:12 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:12 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.746s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:12 devstack sudo[92794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info
Jul 06 13:22:12 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:13 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info" returned: 0 in 0.813s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:13 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info is being set with open permissions: ugo+rw
Jul 06 13:22:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:13 devstack sudo[92797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info
Jul 06 13:22:13 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:14 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.info" returned: 0 in 0.883s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.145s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4cda0834-29b6-4374-bc7b-cf654f7e1c1d tempest-SnapshotsActionsTest-1019578610 None] Create snapshot completed successfully
Jul 06 13:22:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Creating offline snapshot c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[95799a60-0988-46b0-86a4-2d31d50a303b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:15 devstack sudo[92814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:15 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:16 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.926s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:16 devstack sudo[92825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 1G
Jul 06 13:22:16 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (a6b6e8bf-3c20-41e0-9855-516aa0fee42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b607f6bb-085c-4d5a-a217-ee0a166bf8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b607f6bb-085c-4d5a-a217-ee0a166bf8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-819033392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a8258-3fc2-44d9-ba68-36450a161bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:17Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9468c561-a0b5-41a0-b522-8f1a2199fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9468c561-a0b5-41a0-b522-8f1a2199fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383b7d8-b922-4f15-a174-5c57631a1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6383b7d8-b922-4f15-a174-5c57631a1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9a8258-3fc2-44d9-ba68-36450a161bdb', 'volume_name': 'volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d5f99-a73a-4173-a963-39afad010adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590d5f99-a73a-4173-a963-39afad010adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c81edce-f28d-4956-9e99-f369a7dba6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:16 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Volume 9c9a8258-3fc2-44d9-ba68-36450a161bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb', 'volume_size': 1}
Jul 06 13:22:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:17 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 1G" returned: 0 in 1.173s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:17 devstack sudo[92839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16
Jul 06 13:22:17 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:18 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" returned: 0 in 0.909s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:18 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 is being set with open permissions: ugo+rw
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:18 devstack sudo[92855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16
Jul 06 13:22:18 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:18 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:22:18 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:19 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.558s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-819033392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9a8258-3fc2-44d9-ba68-36450a161bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:17Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Creating volume 9c9a8258-3fc2-44d9-ba68-36450a161bdb {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:22:19 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:19 devstack sudo[92869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb 1073741824
Jul 06 13:22:19 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-17d46447-17e6-44cd-a300-3fcc85cdf5fa tempest-SnapshotsActionsTest-1019578610 None] Create snapshot completed successfully
Jul 06 13:22:19 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.924s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Deleting offline snapshot c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] snapshot_file for this snap is: volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d07a09-3a1e-4991-afa3-e76f0d885057]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:19 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16
Jul 06 13:22:19 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:20 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb 1073741824" returned: 0 in 1.036s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:20 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb
Jul 06 13:22:20 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:20 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" returned: 0 in 0.891s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4aaddf-4baf-4ab8-8795-f2d708d3be12]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:20 devstack sudo[92881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:20 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:21 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb" returned: 0 in 0.745s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c81edce-f28d-4956-9e99-f369a7dba6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2d2573-8d28-4382-882d-d7e29b9e4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Volume volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb (9c9a8258-3fc2-44d9-ba68-36450a161bdb): created successfully
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2d2573-8d28-4382-882d-d7e29b9e4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (a6b6e8bf-3c20-41e0-9855-516aa0fee42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3fbd5fa9-9581-43fc-b871-85254ea814e4 tempest-AttachVolumeTestJSON-401772845 None] Created volume successfully.
Jul 06 13:22:21 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.896s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:21 devstack sudo[92887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16
Jul 06 13:22:21 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:22 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" returned: 0 in 1.235s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:22 devstack sudo[92925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16
Jul 06 13:22:22 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:23 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" returned: 0 in 0.980s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16" released by "_delete_snapshot" :: held 4.143s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_snapshot" :: held 4.179s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Created reservations ['462c0e0a-1e3d-4079-a078-0bf4f66696fb', '4de71e1c-13ae-41c7-ac08-e0bd2998f2b8', '484fac33-aebf-448c-ac2a-4944f3355d56', '5e33f7b9-f861-4e81-a4fa-bed5d42512c7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Delete snapshot completed successfully.
Jul 06 13:22:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bcb60b3-77d0-443d-812b-743f71036707 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-c8dfc1ef-ef74-4884-aec7-a5a1db3d2c16-delete_snapshot" released by "delete_snapshot" :: held 4.337s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d90da16-6bf5-42ad-ab74-8c634f3fde76]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:25 devstack sudo[92978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb
Jul 06 13:22:25 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:26 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb" returned: 0 in 0.847s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.796s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Creating offline snapshot 936d7be3-0ae6-40a0-b1dd-c75ebaee4226 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3da882-1359-4da4-822e-a0e332f65d62]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11cd5ebc-f1bb-4160-8e34-055b29e1baaa', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:22:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-9ff5d4c7-7478-4f34-af88-05d4f90e720e req-914e0ab3-9dd9-494d-9cbd-0ecc8bb97cb3 tempest-AttachVolumeTestJSON-401772845 None] attachment_update completed successfully.
Jul 06 13:22:26 devstack sudo[92983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:26 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:27 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.951s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:27 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 1G
Jul 06 13:22:27 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:28 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 1G" returned: 0 in 1.158s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:28 devstack sudo[93376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226
Jul 06 13:22:28 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:29 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226" returned: 0 in 0.792s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:29 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 is being set with open permissions: ugo+rw
Jul 06 13:22:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:29 devstack sudo[93381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226
Jul 06 13:22:29 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:29 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226" returned: 0 in 0.683s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.765s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d63fd944-b9ab-4697-94c1-844f54270f9f tempest-SnapshotsActionsTest-1019578610 None] Create snapshot completed successfully
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-936d7be3-0ae6-40a0-b1dd-c75ebaee4226-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-936d7be3-0ae6-40a0-b1dd-c75ebaee4226-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-936d7be3-0ae6-40a0-b1dd-c75ebaee4226" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-936d7be3-0ae6-40a0-b1dd-c75ebaee4226" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Deleting offline snapshot 936d7be3-0ae6-40a0-b1dd-c75ebaee4226 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:22:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] snapshot_file for this snap is: volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:22:31 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9b803-678f-4911-9959-c749ed5e23a4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:31 devstack sudo[93406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226
Jul 06 13:22:31 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:32 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226" returned: 0 in 0.963s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b64d924-2c9d-448d-abfa-c6c9b9f4d276]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:32 devstack sudo[93414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:32 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:32 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.876s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:32 devstack sudo[93420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226
Jul 06 13:22:32 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:33 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226" returned: 0 in 0.875s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:33 devstack sudo[93430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226
Jul 06 13:22:33 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:34 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.936d7be3-0ae6-40a0-b1dd-c75ebaee4226" returned: 0 in 0.813s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-936d7be3-0ae6-40a0-b1dd-c75ebaee4226" released by "_delete_snapshot" :: held 3.661s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_snapshot" :: held 3.692s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:34 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Created reservations ['d6de8515-3991-4569-a4e7-c23f523f9662', '10725748-594f-4b56-a4b2-e529be9f6887', '8dc81b7e-775f-4497-92b3-3d1a3ea7bb5a', '9b6d52dc-af56-494e-a971-2525de50d762'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Delete snapshot completed successfully.
Jul 06 13:22:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5df9a776-bb42-46a3-8591-8f77d04373a5 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-936d7be3-0ae6-40a0-b1dd-c75ebaee4226-delete_snapshot" released by "delete_snapshot" :: held 3.869s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Creating offline snapshot d0710581-51d7-4be2-90a6-d54590488f13 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ee877-b936-4c7a-9c9b-c250ab87bba5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:35 devstack sudo[93434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:35 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:36 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.824s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:36 devstack sudo[93439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 1G
Jul 06 13:22:36 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:37 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 1G" returned: 0 in 1.095s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:37 devstack sudo[93447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13
Jul 06 13:22:37 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:38 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13" returned: 0 in 0.959s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:38 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 is being set with open permissions: ugo+rw
Jul 06 13:22:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:38 devstack sudo[93454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13
Jul 06 13:22:38 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:39 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13" returned: 0 in 0.770s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f6abbb29-07ad-4e40-a0d8-1f31a7a928da tempest-SnapshotsActionsTest-1019578610 None] Create snapshot completed successfully
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-d0710581-51d7-4be2-90a6-d54590488f13-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-d0710581-51d7-4be2-90a6-d54590488f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-d0710581-51d7-4be2-90a6-d54590488f13" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-d0710581-51d7-4be2-90a6-d54590488f13" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Deleting offline snapshot d0710581-51d7-4be2-90a6-d54590488f13 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] snapshot_file for this snap is: volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7f64a-5ba8-4fc9-9400-413a3132fb3d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:40 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13
Jul 06 13:22:40 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:41 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13" returned: 0 in 1.195s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43b2be-87c4-46a7-87c6-78c89fea6697]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:41 devstack sudo[93588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:41 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:42 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 1.078s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:42 devstack sudo[93603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13
Jul 06 13:22:42 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:43 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13" returned: 0 in 0.937s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:43 devstack sudo[93615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13
Jul 06 13:22:43 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:45 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.d0710581-51d7-4be2-90a6-d54590488f13" returned: 0 in 1.430s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-d0710581-51d7-4be2-90a6-d54590488f13" released by "_delete_snapshot" :: held 4.829s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_snapshot" :: held 4.865s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Acquiring lock "cinder-70072846-9253-4a1a-a983-5cceea7b9168-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "cinder-70072846-9253-4a1a-a983-5cceea7b9168-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Created reservations ['7bb96240-252b-47ba-b55c-861245c6e45b', 'f1e5189b-8e02-4230-835c-c1c9e0512b5d', '4502c895-88b8-444c-9371-863a81b3321c', 'd248caec-f9b2-425a-901b-4776dde6bc73'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Acquiring lock "cinder-quobyte-70072846-9253-4a1a-a983-5cceea7b9168" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "cinder-quobyte-70072846-9253-4a1a-a983-5cceea7b9168" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5288c-b53b-4bf0-9c49-8e109802fb55]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Delete snapshot completed successfully.
Jul 06 13:22:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7da231d6-f18c-40ef-82fd-a67be08f64b4 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-d0710581-51d7-4be2-90a6-d54590488f13-delete_snapshot" released by "delete_snapshot" :: held 5.181s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:45 devstack sudo[93996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168
Jul 06 13:22:45 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Creating offline snapshot e0f02add-4c29-4670-a559-024549ab6ea0 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[67597cc9-dd9b-427e-9260-132f8f109f49]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:46 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:46 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:46 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168" returned: 0 in 1.016s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:46 devstack sudo[94006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168
Jul 06 13:22:46 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:47 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-70072846-9253-4a1a-a983-5cceea7b9168" returned: 0 in 0.999s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "cinder-quobyte-70072846-9253-4a1a-a983-5cceea7b9168" released by "delete_volume" :: held 2.103s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:47 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 1.405s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:47 devstack sudo[94012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 1G
Jul 06 13:22:47 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Created reservations ['9fddc9a7-b616-475f-97b0-7789fddf7dd5', '8c1b4576-2786-481a-b10b-50c3b48479bc', 'c1d7a277-b355-4f5e-b580-34f0ad478aa2', '1a94da92-4b75-4fad-a7be-e4cfeb89eec0'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:47 devstack sudo[94014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:22:47 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Acquiring lock "cinder-6879ee97-e227-43bf-8083-98a96307a8b9-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "cinder-6879ee97-e227-43bf-8083-98a96307a8b9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Acquiring lock "cinder-quobyte-6879ee97-e227-43bf-8083-98a96307a8b9" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "cinder-quobyte-6879ee97-e227-43bf-8083-98a96307a8b9" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc92876-ec25-4e09-8158-cb5ffde07e17]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:48 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9
Jul 06 13:22:48 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:49 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 1G" returned: 0 in 1.456s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:49 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.214s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:22:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Deleted volume successfully.
Jul 06 13:22:49 devstack sudo[94023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0
Jul 06 13:22:49 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dbfd75f-62cd-42c3-b0de-6be936701718 tempest-VolumesNegativeTest-8577847 None] Lock "cinder-70072846-9253-4a1a-a983-5cceea7b9168-delete_volume" released by "delete_volume" :: held 3.855s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:49 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9" returned: 0 in 1.267s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:49 devstack sudo[94030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9
Jul 06 13:22:49 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:50 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0" returned: 0 in 1.064s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:50 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 is being set with open permissions: ugo+rw
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:50 devstack sudo[94035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0
Jul 06 13:22:50 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:50 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6879ee97-e227-43bf-8083-98a96307a8b9" returned: 0 in 0.806s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "cinder-quobyte-6879ee97-e227-43bf-8083-98a96307a8b9" released by "delete_volume" :: held 2.165s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Created reservations ['1372439a-31b2-41f5-8da8-b6533e8019c1', 'cd0802d7-edc4-45c4-bc13-e118cbc65f6f', 'eb1b72c2-2610-403b-8241-56acd06a02a5', 'dd237a98-371c-40d8-a530-eb62816ef47b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:50 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:22:50 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:51 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0" returned: 0 in 0.894s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.962s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5c12eac7-ed32-41a1-a67e-1ea7cc3d7613 tempest-SnapshotsActionsTest-1019578610 None] Create snapshot completed successfully
Jul 06 13:22:51 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.777s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:22:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Deleted volume successfully.
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ae56a6b8-3aa6-49fd-9037-b3f249de5b73 tempest-AttachVolumeShelveTestJSON-90424769 None] Lock "cinder-6879ee97-e227-43bf-8083-98a96307a8b9-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-e0f02add-4c29-4670-a559-024549ab6ea0-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-e0f02add-4c29-4670-a559-024549ab6ea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Acquiring lock "cinder-quobyte-e0f02add-4c29-4670-a559-024549ab6ea0" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-e0f02add-4c29-4670-a559-024549ab6ea0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Deleting offline snapshot e0f02add-4c29-4670-a559-024549ab6ea0 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] snapshot_file for this snap is: volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce794bd3-f58c-4c1b-8e04-cb489b4a5379]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:51 devstack sudo[94042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0
Jul 06 13:22:51 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:52 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0" returned: 0 in 1.182s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d26eb-49cf-48f7-930c-ad052e391136]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Flow 'volume_create_manager' (7faf05e3-d150-467a-9e4c-a96bb49ff658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83605f07-03d7-4fcc-8865-111d1a2ec668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83605f07-03d7-4fcc-8865-111d1a2ec668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1143386780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46759c03014a4e4d979888b8a274f881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:53Z,use_quota=True,user_id='2246598527744d74abed1c016eef94b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a581abc-ca91-4484-b1fd-0bc19505dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a581abc-ca91-4484-b1fd-0bc19505dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce5b13c-d09e-445f-84c1-350588ffc0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ce5b13c-d09e-445f-84c1-350588ffc0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96', 'volume_name': 'volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96', 'volume_size': 2}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:53 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd7ee92-a78c-43a9-bc86-df41eaa60da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:53 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd7ee92-a78c-43a9-bc86-df41eaa60da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe1515-2527-49d9-8cf9-1c5957f0375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Volume a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96', 'volume_size': 2}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1143386780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46759c03014a4e4d979888b8a274f881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:22:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:22:53Z,use_quota=True,user_id='2246598527744d74abed1c016eef94b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Creating volume a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:22:53 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:22:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 2147483648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:53 devstack sudo[94051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 2147483648
Jul 06 13:22:53 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:54 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 1.143s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:54 devstack sudo[94067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0
Jul 06 13:22:54 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:54 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 2147483648" returned: 0 in 1.341s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=73,cinder:SELECT=57,cinder:INSERT=15,cinder:DELETE=8 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:22:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:54 devstack sudo[94070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96
Jul 06 13:22:54 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:55 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0" returned: 0 in 1.147s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:55 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0
Jul 06 13:22:55 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:55 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" returned: 0 in 0.918s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe1515-2527-49d9-8cf9-1c5957f0375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96', 'volume_size': 2}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95baca79-9c86-4fc4-9d8e-6e80cc31839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:22:55 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Volume volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 (a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96): created successfully
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95baca79-9c86-4fc4-9d8e-6e80cc31839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:22:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Flow 'volume_create_manager' (7faf05e3-d150-467a-9e4c-a96bb49ff658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:22:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d646ca40-0abb-4ab8-b015-d3d16491202d tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Created volume successfully.
Jul 06 13:22:56 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.e0f02add-4c29-4670-a559-024549ab6ea0" returned: 0 in 1.039s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-e0f02add-4c29-4670-a559-024549ab6ea0" released by "_delete_snapshot" :: held 4.664s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_snapshot" :: held 4.702s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Created reservations ['6ebe821b-bafa-4965-8537-0c8dae2c4725', '331ae121-f706-4d60-b3e9-a41ae6cf3d31', '34ce1065-8100-430d-9af6-9ef7c3ccc433', 'c15e61c0-65fe-489f-9ec6-f02eb92de5e1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Creating offline snapshot 3dfc9dae-b1c4-4368-bca3-4b52c657592c of volume a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:22:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Delete snapshot completed successfully.
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bd8a7ce9-6936-48e2-8a99-762b4b5300e9 tempest-SnapshotsActionsTest-100545702 None] Lock "cinder-e0f02add-4c29-4670-a559-024549ab6ea0-delete_snapshot" released by "delete_snapshot" :: held 5.101s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca1c0b-b9ad-4949-a0c4-d429a266a189]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:56 devstack sudo[94080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96
Jul 06 13:22:56 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "cinder-ecf857da-6371-4287-b000-6c9123fdd8d8-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:57 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-ecf857da-6371-4287-b000-6c9123fdd8d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" returned: 0 in 1.173s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c 2G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:58 devstack sudo[94086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c 2G
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_snapshot" :: waited 0.098s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "cinder-quobyte-ecf857da-6371-4287-b000-6c9123fdd8d8" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:22:58 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-ecf857da-6371-4287-b000-6c9123fdd8d8" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Deleting offline snapshot ecf857da-6371-4287-b000-6c9123fdd8d8 of volume fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] snapshot_file for this snap is: volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750e605-c087-4c10-a062-8e992141ea5c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:58 devstack sudo[94088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:22:58 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:59 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 1.061s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa135606-e268-41bb-9f56-e97c9dfaab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:22:59 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c 2G" returned: 0 in 1.274s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca08ac-677b-458e-b4e3-071ab8ba46fb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:22:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:22:59 devstack sudo[94105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c
Jul 06 13:22:59 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:22:59 devstack sudo[94106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89
Jul 06 13:22:59 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:00 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:00 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c" returned: 0 in 0.874s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:00 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c is being set with open permissions: ugo+rw
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:00 devstack sudo[94117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c
Jul 06 13:23:00 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:00 devstack sudo[94118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:23:00 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:00 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:00 devstack sudo[94125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info
Jul 06 13:23:00 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:00 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.811s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:00 devstack sudo[94127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8
Jul 06 13:23:00 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:01 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info" returned: 0 in 0.764s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:01 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info is being set with open permissions: ugo+rw
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:01 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info
Jul 06 13:23:01 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:01 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89.ecf857da-6371-4287-b000-6c9123fdd8d8" returned: 0 in 0.763s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-ecf857da-6371-4287-b000-6c9123fdd8d8" released by "_delete_snapshot" :: held 3.660s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_snapshot" :: held 3.708s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Created reservations ['9ef8f545-e8f9-428d-929d-aeb983699e46', '60f2b100-2c8d-4297-9151-cc5be813692c', 'cc5fe1e5-19ef-4fe8-b12b-80222e0a902f', '625216b4-f66c-4f78-8a1e-b37b5403a3d2'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:01 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Delete snapshot completed successfully.
Jul 06 13:23:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7c5a1eac-4424-4fe3-a594-74fb9a7d90a2 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-ecf857da-6371-4287-b000-6c9123fdd8d8-delete_snapshot" released by "delete_snapshot" :: held 4.015s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Flow 'volume_create_manager' (3e4144ee-3ea4-4b7e-864e-2c2f5898ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9493610-899d-42cd-b248-b5b254ab48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9493610-899d-42cd-b248-b5b254ab48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-893563232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5437355-3d12-4c40-ba5e-eada2b17f648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd780deb8004683b9f261b89be6b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:02Z,use_quota=True,user_id='95fb2d6fc3654f948fce071cb7b597e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d617428-3ee9-4ccc-8d8f-6eaaf6e85ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d617428-3ee9-4ccc-8d8f-6eaaf6e85ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2783dbcf-2c65-4578-a701-3128eea8ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2783dbcf-2c65-4578-a701-3128eea8ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5437355-3d12-4c40-ba5e-eada2b17f648', 'volume_name': 'volume-e5437355-3d12-4c40-ba5e-eada2b17f648', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e66291a-2dc9-44d3-8bf9-ca7ef3f04159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e66291a-2dc9-44d3-8bf9-ca7ef3f04159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5371abe4-d8bd-4531-8255-94123df163c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Volume e5437355-3d12-4c40-ba5e-eada2b17f648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5437355-3d12-4c40-ba5e-eada2b17f648', 'volume_size': 1}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "cinder-fa135606-e268-41bb-9f56-e97c9dfaab89-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-fa135606-e268-41bb-9f56-e97c9dfaab89-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:02 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.info" returned: 0 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.707s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" acquired by "delete_volume" :: waited 0.045s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.243s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-893563232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5437355-3d12-4c40-ba5e-eada2b17f648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd780deb8004683b9f261b89be6b50a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:02Z,use_quota=True,user_id='95fb2d6fc3654f948fce071cb7b597e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Creating volume e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:02 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4e848b-8b9a-4c17-8b4e-45077eedd542]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:02 devstack sudo[94195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 1073741824
Jul 06 13:23:02 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-384abd5d-ef83-44a3-b8bb-e5c8c837fd68 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Create snapshot completed successfully
Jul 06 13:23:02 devstack sudo[94196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89
Jul 06 13:23:02 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "cinder-3dfc9dae-b1c4-4368-bca3-4b52c657592c-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-3dfc9dae-b1c4-4368-bca3-4b52c657592c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "cinder-quobyte-3dfc9dae-b1c4-4368-bca3-4b52c657592c" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-3dfc9dae-b1c4-4368-bca3-4b52c657592c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Deleting offline snapshot 3dfc9dae-b1c4-4368-bca3-4b52c657592c of volume a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] snapshot_file for this snap is: volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b899940-f5c0-49c6-a14f-472514ae3235]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:03 devstack sudo[94200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c
Jul 06 13:23:03 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:03 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89" returned: 0 in 0.877s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:03 devstack sudo[94209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89
Jul 06 13:23:03 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:03 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 1073741824" returned: 0 in 1.109s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:03 devstack sudo[94211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648
Jul 06 13:23:03 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:04 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa135606-e268-41bb-9f56-e97c9dfaab89" returned: 0 in 0.686s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-quobyte-fa135606-e268-41bb-9f56-e97c9dfaab89" released by "delete_volume" :: held 1.655s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:04 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c" returned: 0 in 0.972s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[534bc0a8-e932-43b8-ab55-a5803c595444]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Created reservations ['90904488-225f-47a8-9a0a-9bd768a45ccc', '471b1d04-dd80-4549-b43a-5afbaa7ebe4a', '9cabc732-f85a-4774-a4c2-e364bcc607ae', 'bdc2a984-37ab-4d2f-a545-7be524b090e5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:04 devstack sudo[94218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96
Jul 06 13:23:04 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:04 devstack sudo[94221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:04 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:04 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648" returned: 0 in 0.770s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5371abe4-d8bd-4531-8255-94123df163c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5437355-3d12-4c40-ba5e-eada2b17f648', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9baf897-3be2-4ab2-9404-7e4793cd52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:04 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Volume volume-e5437355-3d12-4c40-ba5e-eada2b17f648 (e5437355-3d12-4c40-ba5e-eada2b17f648): created successfully
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9baf897-3be2-4ab2-9404-7e4793cd52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Flow 'volume_create_manager' (3e4144ee-3ea4-4b7e-864e-2c2f5898ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-11dfe848-790f-47ef-ac10-82a022da58b7 req-dc28c927-b45c-43c2-be28-7a12d802b6b3 tempest-VolumesSnapshotsTestJSON-349503160 None] Created volume successfully.
Jul 06 13:23:05 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.698s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Deleted volume successfully.
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-321a8de3-517e-4ac1-ba7c-fa1ef3b31148 tempest-SnapshotsActionsTest-1019578610 None] Lock "cinder-fa135606-e268-41bb-9f56-e97c9dfaab89-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:05 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" returned: 0 in 0.940s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:05 devstack sudo[94227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c
Jul 06 13:23:05 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Creating offline snapshot 906d6cc6-90fc-4e0b-b27f-b2f7271e4761 of volume e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a8bfc9-fae4-4d70-b6c5-cd9836392943]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:06 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c" returned: 0 in 0.995s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:06 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648
Jul 06 13:23:06 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:06 devstack sudo[94236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c
Jul 06 13:23:06 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:07 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96.3dfc9dae-b1c4-4368-bca3-4b52c657592c" returned: 0 in 1.206s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=78,cinder:SELECT=73,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:23:07 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648" returned: 0 in 1.590s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-3dfc9dae-b1c4-4368-bca3-4b52c657592c" released by "_delete_snapshot" :: held 4.316s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" released by "delete_snapshot" :: held 4.360s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:07 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 1G
Jul 06 13:23:07 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Created reservations ['519a688f-8fb5-4aa3-8788-580e31403781', 'd6b87c9f-3950-493c-b0c1-8b1da7676fcf', '784c1360-fafb-4153-84f3-904662256a3e', '309e4de2-abe1-475a-b71b-0bad9ed95e0f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Delete snapshot completed successfully.
Jul 06 13:23:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d820c3d9-9278-4f8f-9e96-aa1a19027498 tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-3dfc9dae-b1c4-4368-bca3-4b52c657592c-delete_snapshot" released by "delete_snapshot" :: held 4.563s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:08 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "cinder-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 1G" returned: 0 in 1.098s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5437355-3d12-4c40-ba5e-eada2b17f648 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:08 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5437355-3d12-4c40-ba5e-eada2b17f648 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761
Jul 06 13:23:08 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[17520098-66af-49e6-bda0-dc8f5afe09f8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:08 devstack sudo[94249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96
Jul 06 13:23:08 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:09 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5437355-3d12-4c40-ba5e-eada2b17f648 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761" returned: 0 in 0.926s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:09 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 is being set with open permissions: ugo+rw
Jul 06 13:23:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:09 devstack sudo[94260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761
Jul 06 13:23:09 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:09 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" returned: 0 in 0.945s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:09 devstack sudo[94263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96
Jul 06 13:23:09 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:10 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761" returned: 0 in 0.707s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:10 devstack sudo[94267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info
Jul 06 13:23:10 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:10 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" returned: 0 in 0.723s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-quobyte-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96" released by "delete_volume" :: held 1.744s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Created reservations ['71f17273-562a-4feb-99b1-91bd6f918718', 'c80e7658-e66a-4aae-b154-071077c1410c', 'e973a16a-74c4-415c-83d4-52dbc6146496', '165da91a-93ea-44f9-8f74-20c926212c7d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:10 devstack sudo[94271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:10 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-6ae3fdb0-e050-45c0-86b4-7ad8da91f240 req-c1aad1c5-14c5-4ce2-af1c-bb21041d2f60 tempest-AttachVolumeTestJSON-401772845 None] Terminate volume connection completed successfully.
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-6ae3fdb0-e050-45c0-86b4-7ad8da91f240 req-c1aad1c5-14c5-4ce2-af1c-bb21041d2f60 tempest-AttachVolumeTestJSON-401772845 None] Deleting attachment 11cd5ebc-f1bb-4160-8e34-055b29e1baaa. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:23:10 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info" returned: 0 in 0.784s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:10 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info is being set with open permissions: ugo+rw
Jul 06 13:23:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:10 devstack sudo[94275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info
Jul 06 13:23:10 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:11 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.934s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:11 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Deleted volume successfully.
Jul 06 13:23:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-29cbf00b-713f-4e0c-a556-e66ef7c1542b tempest-VolumesSnapshotNegativeTestJSON-215851379 None] Lock "cinder-a31e6cfd-4576-4f3c-8e84-5cf12f4c2c96-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:11 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.info" returned: 0 in 1.021s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.240s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-ad495088-649f-4512-affd-ef91482413bc req-0ae0df3c-f755-431f-bf53-a26a4b0628ff tempest-VolumesSnapshotsTestJSON-349503160 None] Create snapshot completed successfully
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "cinder-906d6cc6-90fc-4e0b-b27f-b2f7271e4761-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-906d6cc6-90fc-4e0b-b27f-b2f7271e4761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "cinder-quobyte-906d6cc6-90fc-4e0b-b27f-b2f7271e4761" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-906d6cc6-90fc-4e0b-b27f-b2f7271e4761" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Deleting offline snapshot 906d6cc6-90fc-4e0b-b27f-b2f7271e4761 of volume e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] snapshot_file for this snap is: volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b0cb5d-16b3-4ff2-874a-874fba08c5d8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:12 devstack sudo[94281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761
Jul 06 13:23:12 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:13 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761" returned: 0 in 1.061s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5437355-3d12-4c40-ba5e-eada2b17f648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:23:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[28465217-6430-4870-973a-4ab8e4296382]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:13 devstack sudo[94290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648
Jul 06 13:23:13 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:14 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648" returned: 0 in 1.002s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:14 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761
Jul 06 13:23:14 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:15 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761" returned: 0 in 1.083s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:15 devstack sudo[94303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761
Jul 06 13:23:15 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:16 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648.906d6cc6-90fc-4e0b-b27f-b2f7271e4761" returned: 0 in 0.940s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-906d6cc6-90fc-4e0b-b27f-b2f7271e4761" released by "_delete_snapshot" :: held 4.219s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" released by "delete_snapshot" :: held 4.267s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:16 devstack cinder-volume[86698]: DEBUG cinder.quota [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Created reservations ['6e3fdf4e-3543-47a4-b185-4bce4eddc958', 'e3e8c000-f047-4612-84bb-afe65ac24e35', '85c023ad-1f19-4afb-a95a-118070e12f93', 'fb3dea87-7b58-4f11-b309-35ca1a81db8d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Delete snapshot completed successfully.
Jul 06 13:23:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-bb1bfc54-ea5a-441e-8ca5-570c9d5cbfe5 req-a27c16b3-7c30-417a-84e7-77f7f6021760 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-906d6cc6-90fc-4e0b-b27f-b2f7271e4761-delete_snapshot" released by "delete_snapshot" :: held 4.487s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "cinder-e5437355-3d12-4c40-ba5e-eada2b17f648-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-e5437355-3d12-4c40-ba5e-eada2b17f648-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0faef-8e7a-4d7c-832b-29485ed7718d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:18 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648
Jul 06 13:23:18 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:18 devstack sudo[94316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:18 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:19 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648" returned: 0 in 1.168s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:19 devstack sudo[94322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648
Jul 06 13:23:19 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:19 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.034s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:23:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Flow 'volume_create_manager' (9ad5c92e-5901-4b3b-af6e-48f6335b6c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdc633c-97b3-4a85-9452-51cc37689f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afdc633c-97b3-4a85-9452-51cc37689f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-341033552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa40524c-b1d9-4ddd-a20e-4acbcf55b503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781180008bc644788a2214e38a2a4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:20Z,use_quota=True,user_id='5a98a66a63bd4d15bbeba05272722b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07b933-62d7-4689-a858-682432368cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07b933-62d7-4689-a858-682432368cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e7858a-8f05-4979-b433-b70104aeade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e7858a-8f05-4979-b433-b70104aeade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa40524c-b1d9-4ddd-a20e-4acbcf55b503', 'volume_name': 'volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7eb584-8323-4696-85d0-932f166bdc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7eb584-8323-4696-85d0-932f166bdc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3f4100-abb8-48a7-a461-1545be3b1c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Volume aa40524c-b1d9-4ddd-a20e-4acbcf55b503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503', 'volume_size': 1}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-341033552',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa40524c-b1d9-4ddd-a20e-4acbcf55b503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='781180008bc644788a2214e38a2a4a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:20Z,use_quota=True,user_id='5a98a66a63bd4d15bbeba05272722b6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Creating volume aa40524c-b1d9-4ddd-a20e-4acbcf55b503 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:20 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:20 devstack sudo[94326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 1073741824
Jul 06 13:23:20 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:20 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e5437355-3d12-4c40-ba5e-eada2b17f648" returned: 0 in 0.793s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-quobyte-e5437355-3d12-4c40-ba5e-eada2b17f648" released by "delete_volume" :: held 2.050s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.quota [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Created reservations ['6899731b-3724-489b-9960-ccff90a23359', 'dd512b8b-07b6-466c-ba05-c39ae9c61883', '6f6be05e-575f-4c23-a0a5-bf6cedb5ac37', '2e91dc9a-8ed9-4c2e-a5f7-5726400c4347'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:20 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:20 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:21 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.111s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:21 devstack cinder-volume[86698]: DEBUG cinder.manager [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Deleted volume successfully.
Jul 06 13:23:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-54f59c2d-a5ab-42af-aa4a-454aa46cdfd1 req-8ba21087-6749-4d5f-ab77-d07ad9142c64 tempest-VolumesSnapshotsTestJSON-349503160 None] Lock "cinder-e5437355-3d12-4c40-ba5e-eada2b17f648-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:21 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 1073741824" returned: 0 in 1.666s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:21 devstack sudo[94351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503
Jul 06 13:23:21 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:22 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" returned: 0 in 0.860s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3f4100-abb8-48a7-a461-1545be3b1c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191abe94-b4d6-44bb-bb4d-9c861b64e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Volume volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 (aa40524c-b1d9-4ddd-a20e-4acbcf55b503): created successfully
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191abe94-b4d6-44bb-bb4d-9c861b64e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Flow 'volume_create_manager' (9ad5c92e-5901-4b3b-af6e-48f6335b6c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5c612185-d31c-48a8-9fc6-8ea0ab9df2e3 tempest-VolumesServicesTestJSON-1550629987 None] Created volume successfully.
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Acquiring lock "cinder-aa40524c-b1d9-4ddd-a20e-4acbcf55b503-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "cinder-aa40524c-b1d9-4ddd-a20e-4acbcf55b503-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Acquiring lock "cinder-quobyte-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "cinder-quobyte-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ea13dd-176b-418a-85e6-4106cff1a424]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:24 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503
Jul 06 13:23:24 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:25 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" returned: 0 in 1.618s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:25 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503
Jul 06 13:23:25 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:26 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" returned: 0 in 0.988s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "cinder-quobyte-aa40524c-b1d9-4ddd-a20e-4acbcf55b503" released by "delete_volume" :: held 2.701s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Created reservations ['837954e2-33c7-465c-ba7c-9f0d801c72e8', 'd6cd64ed-7f1e-4609-b376-e25472338c4a', '7b4f352b-f44a-4509-ae03-f1a214f2bbb2', 'ecbb9b14-3214-4b8a-a6cd-55cd3b00c74a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:26 devstack sudo[94444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:26 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:27 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.117s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:27 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Deleted volume successfully.
Jul 06 13:23:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0e3f5928-c274-4e87-bd46-84f16b2cda3b tempest-VolumesServicesTestJSON-1550629987 None] Lock "cinder-aa40524c-b1d9-4ddd-a20e-4acbcf55b503-delete_volume" released by "delete_volume" :: held 4.252s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (804143c2-e33b-4dc6-a9c9-49186f3b7e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1762eb91-bd05-4342-a335-ca1183108991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1762eb91-bd05-4342-a335-ca1183108991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-633661329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e048a610-01a5-4de9-afd9-ce03fd5e8438,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:28Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34859076-a61e-4ccf-83cd-72b84441c4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34859076-a61e-4ccf-83cd-72b84441c4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4e0168-4347-49a0-bd44-6a07c70911ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4e0168-4347-49a0-bd44-6a07c70911ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e048a610-01a5-4de9-afd9-ce03fd5e8438', 'volume_name': 'volume-e048a610-01a5-4de9-afd9-ce03fd5e8438', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082f47ac-acca-4538-8b06-91a1b4429e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082f47ac-acca-4538-8b06-91a1b4429e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc09bab-d9cb-4334-829e-2e645ccf601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Volume e048a610-01a5-4de9-afd9-ce03fd5e8438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e048a610-01a5-4de9-afd9-ce03fd5e8438', 'volume_size': 1}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-633661329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e048a610-01a5-4de9-afd9-ce03fd5e8438,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:28Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Creating volume e048a610-01a5-4de9-afd9-ce03fd5e8438 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:28 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:28 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 1073741824
Jul 06 13:23:28 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:29 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 1073741824" returned: 0 in 1.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:29 devstack sudo[94455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438
Jul 06 13:23:29 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:30 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438" returned: 0 in 0.918s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] <== create_volume: return (2596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.601s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc09bab-d9cb-4334-829e-2e645ccf601d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e048a610-01a5-4de9-afd9-ce03fd5e8438', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a94a408-a0e9-439b-8e68-88c18c6f8d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Volume volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 (e048a610-01a5-4de9-afd9-ce03fd5e8438): created successfully
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a94a408-a0e9-439b-8e68-88c18c6f8d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (804143c2-e33b-4dc6-a9c9-49186f3b7e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1d7c0eae-8d68-461d-a208-a12d6e4a6435 tempest-VolumesTestJSON-1863997733 None] Created volume successfully.
Jul 06 13:23:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (41999bcf-f444-43ae-bc37-f09736e3076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d3fd6f-cf8f-460c-9620-bdf7a2e5f17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d3fd6f-cf8f-460c-9620-bdf7a2e5f17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384210671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52d601-7862-4f1c-a2e6-0ac83ffebd9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:32Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d740a8-1517-48bb-8b2c-8629f73c0cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d740a8-1517-48bb-8b2c-8629f73c0cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e097d928-d5c6-4d13-b4fa-42a74a851ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e097d928-d5c6-4d13-b4fa-42a74a851ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d52d601-7862-4f1c-a2e6-0ac83ffebd9f', 'volume_name': 'volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b4aa1a-9972-4e9c-acb7-448439f0aafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b4aa1a-9972-4e9c-acb7-448439f0aafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe212c6-378c-4fe0-bb06-f53b37cb7817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Volume 4d52d601-7862-4f1c-a2e6-0ac83ffebd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f', 'volume_size': 1}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384210671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d52d601-7862-4f1c-a2e6-0ac83ffebd9f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:32Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Creating volume 4d52d601-7862-4f1c-a2e6-0ac83ffebd9f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:32 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:32 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f 1073741824
Jul 06 13:23:32 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:33 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f 1073741824" returned: 0 in 1.575s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:33 devstack sudo[94467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f
Jul 06 13:23:33 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:34 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" returned: 0 in 1.184s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] <== create_volume: return (2840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.846s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfe212c6-378c-4fe0-bb06-f53b37cb7817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff17e877-1198-45bf-906a-0e40a4619317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Volume volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f (4d52d601-7862-4f1c-a2e6-0ac83ffebd9f): created successfully
Jul 06 13:23:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff17e877-1198-45bf-906a-0e40a4619317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (41999bcf-f444-43ae-bc37-f09736e3076d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ac07fccb-75a0-4c23-9100-a65bc8c74261 tempest-VolumesTestJSON-1863997733 None] Created volume successfully.
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (a2fda325-c0df-439c-8e1d-90a1519c06c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a00bae-d8a6-4292-b41a-6f34a0fde7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a00bae-d8a6-4292-b41a-6f34a0fde7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992485133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa4e5e-dbbb-4597-8df4-015ba50d700c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:36Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db58517-4722-4f63-b6df-47d24c6b1afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db58517-4722-4f63-b6df-47d24c6b1afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918d0617-a56a-441b-a47a-8e9b47eebf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918d0617-a56a-441b-a47a-8e9b47eebf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3aa4e5e-dbbb-4597-8df4-015ba50d700c', 'volume_name': 'volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de93546-2bb3-4918-99b2-ce18c6c51d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de93546-2bb3-4918-99b2-ce18c6c51d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd92c18a-54cc-4098-8f41-05523db709c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Volume c3aa4e5e-dbbb-4597-8df4-015ba50d700c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c', 'volume_size': 1}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1992485133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa4e5e-dbbb-4597-8df4-015ba50d700c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e349126d59094acbbf37c4e5e4cbb420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:36Z,use_quota=True,user_id='f3eaf050703d4063bbaea4669cbeb78d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Creating volume c3aa4e5e-dbbb-4597-8df4-015ba50d700c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:36 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:36 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c 1073741824
Jul 06 13:23:36 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:37 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c 1073741824" returned: 0 in 1.337s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:38 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c
Jul 06 13:23:38 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:39 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" returned: 0 in 1.018s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd92c18a-54cc-4098-8f41-05523db709c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95049b-5473-437a-84bc-575128784dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Volume volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c (c3aa4e5e-dbbb-4597-8df4-015ba50d700c): created successfully
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95049b-5473-437a-84bc-575128784dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Flow 'volume_create_manager' (a2fda325-c0df-439c-8e1d-90a1519c06c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9c0e14d3-e1de-4101-bdbb-0fd9dafd9315 tempest-VolumesTestJSON-1863997733 None] Created volume successfully.
Jul 06 13:23:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-c3aa4e5e-dbbb-4597-8df4-015ba50d700c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "cinder-c3aa4e5e-dbbb-4597-8df4-015ba50d700c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-quobyte-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc573fb3-afdb-46e7-946b-eea1c4f476ae]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:41 devstack sudo[94483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c
Jul 06 13:23:41 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:42 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" returned: 0 in 1.141s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:42 devstack sudo[94488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c
Jul 06 13:23:42 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:42 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-c3aa4e5e-dbbb-4597-8df4-015ba50d700c" released by "delete_volume" :: held 1.965s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Created reservations ['d26dc459-cb77-4423-9536-2eda502b626b', 'fa432d5a-56b5-42e1-843a-c01b1a436d92', '1b47a951-c1ac-40c8-9b4f-b0235cfc9fa2', '8e818c90-8432-4ccf-bcc6-4503c5bedf2f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:43 devstack sudo[94492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:43 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "cinder-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-quobyte-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[92772977-fc53-416c-af0f-d6075dc9600b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:43 devstack sudo[94494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f
Jul 06 13:23:43 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:44 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.018s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:44 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Deleted volume successfully.
Jul 06 13:23:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-997f0a74-e7d9-499a-bbb5-351b7edb176d tempest-VolumesTestJSON-1863997733 None] Lock "cinder-c3aa4e5e-dbbb-4597-8df4-015ba50d700c-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:44 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" returned: 0 in 1.330s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:44 devstack sudo[94500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f
Jul 06 13:23:44 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:45 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" returned: 0 in 0.993s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f" released by "delete_volume" :: held 2.403s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Created reservations ['b879a97f-c86b-4366-81bf-2843b4a38bd0', '2f2cdd45-ebd1-4817-9817-06eb0690d584', '11a4f34b-160c-48d2-a02e-46d8d0e8fa7a', 'aea32b1f-56e9-46d2-a26b-76826ac08a60'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:46 devstack sudo[94505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:46 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-e048a610-01a5-4de9-afd9-ce03fd5e8438-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "cinder-e048a610-01a5-4de9-afd9-ce03fd5e8438-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Acquiring lock "cinder-quobyte-e048a610-01a5-4de9-afd9-ce03fd5e8438" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-e048a610-01a5-4de9-afd9-ce03fd5e8438" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdc9330-41d6-4ac9-916a-7bc616f1ac71]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:47 devstack sudo[94507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438
Jul 06 13:23:47 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:47 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.117s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:47 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:47 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Deleted volume successfully.
Jul 06 13:23:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0887b34e-755a-4ac2-ab75-693a15f390a0 tempest-VolumesTestJSON-1863997733 None] Lock "cinder-4d52d601-7862-4f1c-a2e6-0ac83ffebd9f-delete_volume" released by "delete_volume" :: held 3.938s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:47 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438" returned: 0 in 1.053s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:47 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438
Jul 06 13:23:47 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (5b174b65-5b16-4be8-a1ab-dd555a77e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cac0092-8e3f-493b-9b1f-9c7857adcc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cac0092-8e3f-493b-9b1f-9c7857adcc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-916924450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ffdb54-7c62-4412-9673-39f0647d4c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb354073b18743a982701061c9e9c312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:49Z,use_quota=True,user_id='cfdb0d5b771e4ca8a8a71f999ea6e887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5480f1-c4a8-4f10-9bc2-f4e6098ff127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c5480f1-c4a8-4f10-9bc2-f4e6098ff127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca665ec4-ef23-4490-8f8d-3394552f4d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca665ec4-ef23-4490-8f8d-3394552f4d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ffdb54-7c62-4412-9673-39f0647d4c7a', 'volume_name': 'volume-59ffdb54-7c62-4412-9673-39f0647d4c7a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9038575f-76f5-41fb-94d9-b0afd143da64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9038575f-76f5-41fb-94d9-b0afd143da64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce10cf7-e5e4-4ece-91b1-f4ec50004644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Volume 59ffdb54-7c62-4412-9673-39f0647d4c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ffdb54-7c62-4412-9673-39f0647d4c7a', 'volume_size': 1}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-916924450',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ffdb54-7c62-4412-9673-39f0647d4c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb354073b18743a982701061c9e9c312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:23:49Z,use_quota=True,user_id='cfdb0d5b771e4ca8a8a71f999ea6e887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Creating volume 59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:23:48 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:23:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:48 devstack sudo[94519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a 1073741824
Jul 06 13:23:48 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:49 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e048a610-01a5-4de9-afd9-ce03fd5e8438" returned: 0 in 1.257s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "cinder-quobyte-e048a610-01a5-4de9-afd9-ce03fd5e8438" released by "delete_volume" :: held 2.384s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Created reservations ['037ac749-5fa4-4427-b838-5de2417e664f', '51610ce7-2dd5-4af5-bbb3-22fb5a5594d8', 'da9dcf95-af0c-40c7-8b38-ec735ead4b50', '6e83022c-49ab-4498-95b9-bf89e25eb62b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:49 devstack sudo[94522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:23:49 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:50 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a 1073741824" returned: 0 in 1.195s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:50 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:23:50 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:50 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.827s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:50 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:23:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Deleted volume successfully.
Jul 06 13:23:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-99fd0fb8-f192-4276-8c83-7b98b8c99e7e tempest-VolumesTestJSON-1863997733 None] Lock "cinder-e048a610-01a5-4de9-afd9-ce03fd5e8438-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:23:51 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.053s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce10cf7-e5e4-4ece-91b1-f4ec50004644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ffdb54-7c62-4412-9673-39f0647d4c7a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b8abc0-332b-48d8-901e-777a39b37d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:23:51 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Volume volume-59ffdb54-7c62-4412-9673-39f0647d4c7a (59ffdb54-7c62-4412-9673-39f0647d4c7a): created successfully
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b8abc0-332b-48d8-901e-777a39b37d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:23:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (5b174b65-5b16-4be8-a1ab-dd555a77e98d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:23:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-729c026d-df4e-4cd0-b5bf-4696934e3951 tempest-VolumesDeleteCascade-1561851462 None] Created volume successfully.
Jul 06 13:23:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Creating offline snapshot 5f708848-5606-48a2-a66f-bb7615714498 of volume 59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:23:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554a6d5-2998-45dc-99c1-742a0c9ffa3b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:52 devstack sudo[94556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:23:52 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:53 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.100s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:53 devstack sudo[94562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 1G
Jul 06 13:23:53 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:54 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 1G" returned: 0 in 1.044s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:54 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:23:54 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:55 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 1.006s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:55 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 is being set with open permissions: ugo+rw
Jul 06 13:23:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:55 devstack sudo[94578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:23:55 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:56 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 0.816s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:56 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:DELETE=7,cinder:SELECT=87,cinder:INSERT=30,cinder:UPDATE=98 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:23:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:56 devstack sudo[94582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info
Jul 06 13:23:56 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:57 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info" returned: 0 in 0.869s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:57 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info is being set with open permissions: ugo+rw
Jul 06 13:23:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:57 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info
Jul 06 13:23:57 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:58 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.info" returned: 0 in 0.951s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.927s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:23:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-98f5a4f5-e0c8-4247-95c6-c14e9f572535 tempest-VolumesDeleteCascade-1561851462 None] Create snapshot completed successfully
Jul 06 13:23:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:23:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:23:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Creating offline snapshot 951144f0-fd42-471b-9d20-2cd97d5523c9 of volume 59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:23:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4ab88-55d0-4e32-a912-a804732dc335]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:23:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:23:59 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:23:59 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:23:59 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Jul 06 13:23:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 0.964s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:23:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb54-7c62-4412-9673-39f0647d4c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:23:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:00 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 1G
Jul 06 13:24:00 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:01 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 1G" returned: 0 in 1.253s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:01 devstack sudo[94598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:01 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:02 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.237s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:02 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 is being set with open permissions: ugo+rw
Jul 06 13:24:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:02 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:02 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:03 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.138s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.760s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cae67af0-420d-4bf4-bcf1-f30d1305ab23 tempest-GroupsV314Test-690851427 None] Group tempest-GroupsV314Test-Group-1114882016: creating
Jul 06 13:24:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1553b7ae-72c4-4f12-8bbd-81eeaa75b179 tempest-VolumesDeleteCascade-1561851462 None] Create snapshot completed successfully
Jul 06 13:24:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cae67af0-420d-4bf4-bcf1-f30d1305ab23 tempest-GroupsV314Test-690851427 None] Group tempest-GroupsV314Test-Group-1114882016: created successfully
Jul 06 13:24:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cae67af0-420d-4bf4-bcf1-f30d1305ab23 tempest-GroupsV314Test-690851427 None] Create group completed successfully.
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-59ffdb54-7c62-4412-9673-39f0647d4c7a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-59ffdb54-7c62-4412-9673-39f0647d4c7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Performing cascade delete. {{(pid=86698) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-5f708848-5606-48a2-a66f-bb7615714498-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-5f708848-5606-48a2-a66f-bb7615714498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-5f708848-5606-48a2-a66f-bb7615714498" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-5f708848-5606-48a2-a66f-bb7615714498" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Deleting offline snapshot 5f708848-5606-48a2-a66f-bb7615714498 of volume 59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] snapshot_file for this snap is: volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af285c-7f44-41c0-8650-a4f444832fbc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:04 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:24:04 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:05 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 1.045s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb54-7c62-4412-9673-39f0647d4c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b72837-bdea-4c56-8b56-361b644e8463]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:24:05 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:24:05 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Flow 'volume_create_manager' (2d4565e4-316b-410b-b993-c2ed737c33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101bf128-c870-4c95-a5b4-723cef1a13f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101bf128-c870-4c95-a5b4-723cef1a13f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348590605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c762d39-4b97-48ba-96a2-c353671b5892,host='devstack@QuobyteHD#QuobyteHD',id=dde471f9-c873-44e4-967e-ec23af17caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0909364a2245f89fe6ea10782f2334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:06Z,use_quota=True,user_id='17ae5c6e6f6e4009afb2de740b900a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50106345-b512-4fb3-9401-1cbc8feeda75),volume_type_id=50106345-b512-4fb3-9401-1cbc8feeda75)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e686e4e-10f5-4a37-a708-10382641b561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e686e4e-10f5-4a37-a708-10382641b561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabad1c3-0331-4cb6-af43-511d63fe9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabad1c3-0331-4cb6-af43-511d63fe9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde471f9-c873-44e4-967e-ec23af17caf0', 'volume_name': 'volume-dde471f9-c873-44e4-967e-ec23af17caf0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f227109-45e2-4e0c-add6-faf466a5ec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f227109-45e2-4e0c-add6-faf466a5ec3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c0684a-61c7-4c2e-bd7b-32fdca5dcbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Volume dde471f9-c873-44e4-967e-ec23af17caf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde471f9-c873-44e4-967e-ec23af17caf0', 'volume_size': 1}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c762d39-4b97-48ba-96a2-c353671b5892,created_at=2026-07-06T11:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348590605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c762d39-4b97-48ba-96a2-c353671b5892,host='devstack@QuobyteHD#QuobyteHD',id=dde471f9-c873-44e4-967e-ec23af17caf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0909364a2245f89fe6ea10782f2334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:06Z,use_quota=True,user_id='17ae5c6e6f6e4009afb2de740b900a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50106345-b512-4fb3-9401-1cbc8feeda75),volume_type_id=50106345-b512-4fb3-9401-1cbc8feeda75)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Creating volume dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:24:05 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:24:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:05 devstack sudo[94686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 1073741824
Jul 06 13:24:05 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:06 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 0.872s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:06 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5f50ec-117a-4b29-93d6-d2e6137d3b9b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:06 devstack sudo[94698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:06 devstack sudo[94698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:06 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 1073741824" returned: 0 in 1.154s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:07 devstack sudo[94729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:07 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:07 devstack sudo[94698]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.266s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb54-7c62-4412-9673-39f0647d4c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9cc023-7185-4fbf-b2fa-e360f0aa5e64]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:07 devstack sudo[94748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:24:07 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:07 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 0.923s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c0684a-61c7-4c2e-bd7b-32fdca5dcbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde471f9-c873-44e4-967e-ec23af17caf0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe89008b-e5aa-4204-a8f2-d9e61ad12b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Volume volume-dde471f9-c873-44e4-967e-ec23af17caf0 (dde471f9-c873-44e4-967e-ec23af17caf0): created successfully
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe89008b-e5aa-4204-a8f2-d9e61ad12b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Flow 'volume_create_manager' (2d4565e4-316b-410b-b993-c2ed737c33a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=56,cinder:INSERT=19,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:24:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-300da103-3574-4cc8-99b9-03a1c9efc8ab tempest-GroupsV314Test-690851427 None] Created volume successfully.
Jul 06 13:24:08 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 0.885s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb54-7c62-4412-9673-39f0647d4c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1eace2-c1fa-4ed1-acab-ef2d43a47d2a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:08 devstack sudo[94773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:24:08 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:09 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Cloning volume dde471f9-c873-44e4-967e-ec23af17caf0 to volume 51b9eebd-c3b9-49a6-96c5-0fd4fab1599b
Jul 06 13:24:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Creating offline snapshot 98803ab1-fa65-4e30-8a67-aee0082dc5fd of volume dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:24:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5090b9-c429-483d-87d2-93982b8a399b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:10 devstack sudo[94777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:10 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:10 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.680s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:10 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:24:10 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:11 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 2.125s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:11 devstack sudo[94800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd 1G
Jul 06 13:24:11 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:12 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 1.695s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:12 devstack sudo[94805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498
Jul 06 13:24:12 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:13 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.5f708848-5606-48a2-a66f-bb7615714498" returned: 0 in 1.128s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 -F qcow2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:13 devstack sudo[94813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 -F qcow2
Jul 06 13:24:13 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:13 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd 1G" returned: 0 in 2.060s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde471f9-c873-44e4-967e-ec23af17caf0 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:13 devstack sudo[94819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde471f9-c873-44e4-967e-ec23af17caf0 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:13 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:14 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59ffdb54-7c62-4412-9673-39f0647d4c7a /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 -F qcow2" returned: 0 in 1.305s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-5f708848-5606-48a2-a66f-bb7615714498" released by "_delete_snapshot" :: held 10.143s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" released by "delete_snapshot" :: held 10.176s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Flow 'volume_create_manager' (fe649461-d37e-47fc-97fd-c5ff49b82aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0972ca-5e4e-474b-a4ed-4d69aaefe7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0972ca-5e4e-474b-a4ed-4d69aaefe7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1930638241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82e90d4-ccdc-46f0-a159-2b5803c2e909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c438da1d7047ffb6c63c45f1c22a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:15Z,use_quota=True,user_id='3888b0177de148e683ff023c9af61db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4f1d13-5628-4094-90c6-5d3db2aac239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4f1d13-5628-4094-90c6-5d3db2aac239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9c99a3-8c8c-4bfe-9924-7b8c5093eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9c99a3-8c8c-4bfe-9924-7b8c5093eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82e90d4-ccdc-46f0-a159-2b5803c2e909', 'volume_name': 'volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749fd645-3f95-4306-8197-5338c1671523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749fd645-3f95-4306-8197-5338c1671523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245490a-06aa-4cee-a7fc-7cffe45897b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:14 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Volume f82e90d4-ccdc-46f0-a159-2b5803c2e909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909', 'volume_size': 1}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['a2a75cfb-59c7-4afb-b596-bceeaaef6ca8', '22fcdce7-b2a0-435c-931c-3725c3540e6d', '3afca53a-8be9-443f-942e-0ce349ac9edc', '39a33a4e-27ff-40d8-9dcf-ba1e3aa44f53'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Delete snapshot completed successfully.
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-5f708848-5606-48a2-a66f-bb7615714498-delete_snapshot" released by "delete_snapshot" :: held 10.534s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-951144f0-fd42-471b-9d20-2cd97d5523c9-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-951144f0-fd42-471b-9d20-2cd97d5523c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-951144f0-fd42-471b-9d20-2cd97d5523c9" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-951144f0-fd42-471b-9d20-2cd97d5523c9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Deleting offline snapshot 951144f0-fd42-471b-9d20-2cd97d5523c9 of volume 59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] snapshot_file for this snap is: volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0677be-fbf8-4670-8fe1-869931615e2f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:15 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dde471f9-c873-44e4-967e-ec23af17caf0 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 1.333s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:15 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:15 devstack sudo[94829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:15 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:15 devstack sudo[94828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:15 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:15 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 0.814s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:16 devstack sudo[94836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info
Jul 06 13:24:16 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:16 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.033s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59ffdb54-7c62-4412-9673-39f0647d4c7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24b465e-e558-4a53-8c91-960bd6827539]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:16 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:24:16 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:16 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info" returned: 0 in 0.942s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:16 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:24:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:16 devstack sudo[94857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info
Jul 06 13:24:16 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:17 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.355s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:17 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:17 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:18 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.info" returned: 0 in 1.292s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Acquiring lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] snapshot: 98803ab1-fa65-4e30-8a67-aee0082dc5fd, volume: 51b9eebd-c3b9-49a6-96c5-0fd4fab1599b,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f8e643-b149-4840-97cc-ad4abf9c18cf]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:18 devstack sudo[94903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:18 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:18 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:24:18 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:18 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.309s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:18 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9
Jul 06 13:24:18 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:19 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 1.467s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde471f9-c873-44e4-967e-ec23af17caf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d53ed-381b-434d-bf13-c91195b2c116]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:19 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a.951144f0-fd42-471b-9d20-2cd97d5523c9" returned: 0 in 1.040s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-951144f0-fd42-471b-9d20-2cd97d5523c9" released by "_delete_snapshot" :: held 4.915s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" released by "delete_snapshot" :: held 4.963s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:20 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.587s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:24:20 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:20 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['bebdfa9f-a9da-41e4-91f6-fe16f715472f', '4262bb2a-76da-4af9-874e-508cdd99d762', '5f422eda-bcad-48ef-acdb-6aabf4cf5974', 'cf5c9114-3e7b-4265-8a36-042a68cd06af'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Delete snapshot completed successfully.
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-951144f0-fd42-471b-9d20-2cd97d5523c9-delete_snapshot" released by "delete_snapshot" :: held 5.519s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Snapshots deleted, issuing volume delete {{(pid=86698) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbdba8-70da-4bfe-9499-571bfdcdbe9d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:20 devstack sudo[94941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:24:20 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:21 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 1.605s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:21 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:24:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:21 devstack sudo[94948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b
Jul 06 13:24:21 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:21 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.419s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:22 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a
Jul 06 13:24:22 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:23 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59ffdb54-7c62-4412-9673-39f0647d4c7a" returned: 0 in 1.554s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-59ffdb54-7c62-4412-9673-39f0647d4c7a" released by "delete_volume" :: held 3.103s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['b3782a6a-ff69-49aa-8abe-efa02ddcec62', 'd2a5e6fb-15d9-494c-86a2-29fd3c1c3233', '7c7fe254-693a-438a-bb65-17ca568f97a4', '6ebe8353-2535-4b04-ab67-fcc08f058417'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:24 devstack sudo[94988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:24:24 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:27 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 3.209s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:24:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Deleted volume successfully.
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ee62e9c1-f786-4341-83c5-79060c65757f tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-59ffdb54-7c62-4412-9673-39f0647d4c7a-delete_volume" released by "delete_volume" :: held 23.033s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (03a1f2e8-a426-4e91-8d70-423205c5151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68235c8a-13ae-42be-966f-8bfcb86966f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68235c8a-13ae-42be-966f-8bfcb86966f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-971037437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2feb16-d5c0-4290-8fec-a435fd73d482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb354073b18743a982701061c9e9c312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:27Z,use_quota=True,user_id='cfdb0d5b771e4ca8a8a71f999ea6e887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16715140-08d3-4ef0-bb61-5000883daa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16715140-08d3-4ef0-bb61-5000883daa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb2339a-9e34-49e5-beed-24b2ce0c2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb2339a-9e34-49e5-beed-24b2ce0c2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2feb16-d5c0-4290-8fec-a435fd73d482', 'volume_name': 'volume-cb2feb16-d5c0-4290-8fec-a435fd73d482', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f76b826-752e-49bf-b2f0-f9c56617c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f76b826-752e-49bf-b2f0-f9c56617c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fecc447-3a36-41fe-b00a-d4cf0ff3a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Volume cb2feb16-d5c0-4290-8fec-a435fd73d482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2feb16-d5c0-4290-8fec-a435fd73d482', 'volume_size': 1}
Jul 06 13:24:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" returned: 0 in 8.323s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f242a78-f699-443a-a17b-f49b4b7fb3c0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:29 devstack sudo[94995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:29 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:30 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 1.117s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:30 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:24:30 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Converted 1024.00 MB image at 123.01 MB/s
Jul 06 13:24:30 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 13:24:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:30 devstack sudo[95002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b
Jul 06 13:24:30 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:31 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" returned: 0 in 0.675s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" released by "_copy_volume_from_snapshot" :: held 13.299s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Acquiring lock "cinder-quobyte-98803ab1-fa65-4e30-8a67-aee0082dc5fd" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-98803ab1-fa65-4e30-8a67-aee0082dc5fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Deleting offline snapshot 98803ab1-fa65-4e30-8a67-aee0082dc5fd of volume dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] snapshot_file for this snap is: volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c4bd7d-a4c7-4481-8813-1783af1df8fd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:31 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:31 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:32 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dde471f9-c873-44e4-967e-ec23af17caf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf12ec-6a87-4e61-8736-87c00ef1a428]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:32 devstack sudo[95022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:32 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:33 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 0.788s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:33 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:33 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:34 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 0.715s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:34 devstack sudo[95036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd
Jul 06 13:24:34 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:34 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0.98803ab1-fa65-4e30-8a67-aee0082dc5fd" returned: 0 in 0.662s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-98803ab1-fa65-4e30-8a67-aee0082dc5fd" released by "_delete_snapshot" :: held 3.103s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.177s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.999s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1930638241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82e90d4-ccdc-46f0-a159-2b5803c2e909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c438da1d7047ffb6c63c45f1c22a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:15Z,use_quota=True,user_id='3888b0177de148e683ff023c9af61db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Creating volume f82e90d4-ccdc-46f0-a159-2b5803c2e909 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:24:34 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:24:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:34 devstack sudo[95039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 1073741824
Jul 06 13:24:34 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6148ed7f-c9e9-4025-a52c-f36e7a81d34a tempest-GroupsV314Test-690851427 None] Create group from source-group-7c762d39-4b97-48ba-96a2-c353671b5892 completed successfully.
Jul 06 13:24:35 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 1073741824" returned: 0 in 0.881s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:35 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909
Jul 06 13:24:35 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Acquiring lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[003374e6-a979-4479-9342-7236d99bd311]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:36 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b
Jul 06 13:24:36 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:36 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909" returned: 0 in 0.688s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.349s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-971037437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2feb16-d5c0-4290-8fec-a435fd73d482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb354073b18743a982701061c9e9c312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:27Z,use_quota=True,user_id='cfdb0d5b771e4ca8a8a71f999ea6e887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Creating volume cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:24:36 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245490a-06aa-4cee-a7fc-7cffe45897b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:36 devstack sudo[95049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 1073741824
Jul 06 13:24:36 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f8fffc-3862-4241-8d7e-e272acb89754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Volume volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 (f82e90d4-ccdc-46f0-a159-2b5803c2e909): created successfully
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f8fffc-3862-4241-8d7e-e272acb89754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Flow 'volume_create_manager' (fe649461-d37e-47fc-97fd-c5ff49b82aa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f1c814e1-a542-4d1b-9ea9-902af276f720 tempest-TestMinimumBasicScenario-2073313970 None] Created volume successfully.
Jul 06 13:24:36 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" returned: 0 in 0.834s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:36 devstack sudo[95054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b
Jul 06 13:24:36 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:37 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 1073741824" returned: 0 in 1.004s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:37 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:24:37 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:37 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" returned: 0 in 0.760s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-51b9eebd-c3b9-49a6-96c5-0fd4fab1599b" released by "delete_volume" :: held 1.651s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Created reservations ['fa108efc-3864-453a-9e47-0eed17cd9806'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:37 devstack cinder-volume[86698]: WARNING cinder.quota [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-372002622 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-372002622, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:24:37 devstack cinder-volume[86698]: WARNING cinder.quota [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-372002622 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-372002622, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Created reservations ['d3f819bc-9583-4ffa-b526-359979388729', '6785ccd9-9377-48dc-aac7-da1d058a274d', '307a1b1f-0359-4a68-826b-b2df198e6913', '618a8d8c-ba93-4fff-bad9-50dd4c642e8a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:37 devstack sudo[95067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:24:37 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:38 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fecc447-3a36-41fe-b00a-d4cf0ff3a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2feb16-d5c0-4290-8fec-a435fd73d482', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b877c96-1e2b-4b62-9f5c-c2c536a3e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:38 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Volume volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 (cb2feb16-d5c0-4290-8fec-a435fd73d482): created successfully
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b877c96-1e2b-4b62-9f5c-c2c536a3e77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (03a1f2e8-a426-4e91-8d70-423205c5151c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-86e4b9e1-f23e-4c96-888c-fbc263ad465c tempest-VolumesDeleteCascade-1561851462 None] Created volume successfully.
Jul 06 13:24:38 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.678s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:24:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e365ce86-f1ea-43aa-ae24-5dc992cd3546 tempest-GroupsV314Test-690851427 None] Delete group completed successfully.
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Acquiring lock "cinder-quobyte-dde471f9-c873-44e4-967e-ec23af17caf0" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-dde471f9-c873-44e4-967e-ec23af17caf0" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5500bb-c561-4980-8d5c-943f352e874f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:38 devstack sudo[95072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:38 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Creating offline snapshot 3f32c1b4-0865-47e6-97da-683a30a1f457 of volume cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1c2a62-669c-48bc-8047-7d41e0791701]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:39 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 0.783s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:39 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0
Jul 06 13:24:39 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:39 devstack sudo[95077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:24:39 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:40 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dde471f9-c873-44e4-967e-ec23af17caf0" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:40 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Lock "cinder-quobyte-dde471f9-c873-44e4-967e-ec23af17caf0" released by "delete_volume" :: held 1.582s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 0.848s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:40 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 1G
Jul 06 13:24:40 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Created reservations ['414c2e46-9832-432c-a13f-f8a409c5371c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Created reservations ['8d90b1d6-dd4c-4979-bd6e-edf37a07fc6c', 'adf7e64f-6da1-443e-93a3-8175a131fb4f', '88ecda28-7f6f-41cd-9a92-c1e1f3fc5ef1', '39b0d53d-8706-45fc-8cc8-e636a42a0eb8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:40 devstack sudo[95088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:24:40 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:41 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 1G" returned: 0 in 1.015s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:41 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.803s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:41 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:24:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d6953726-9e15-4480-b90f-61f8b776464a tempest-GroupsV314Test-690851427 None] Delete group completed successfully.
Jul 06 13:24:41 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:24:41 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:42 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 0.815s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:42 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 is being set with open permissions: ugo+rw
Jul 06 13:24:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:42 devstack sudo[95108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:24:42 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:42 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 0.854s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:43 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info
Jul 06 13:24:43 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:43 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info" returned: 0 in 0.850s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:43 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info is being set with open permissions: ugo+rw
Jul 06 13:24:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:43 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info
Jul 06 13:24:43 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:44 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.info" returned: 0 in 0.703s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.187s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.781s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751fd81-cb23-49b0-89ca-c8712f223016]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-29386fc5-a3ae-4d10-8270-128f46deedf5 tempest-VolumesDeleteCascade-1561851462 None] Create snapshot completed successfully
Jul 06 13:24:44 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909
Jul 06 13:24:44 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:45 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.828s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3062e579-acdf-48f4-ab2a-86caeb4ec0ea', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:24:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-f65faac7-7faa-4c4c-9714-8f334ca79f3c req-430e35aa-0a5a-4a83-a9a1-051886f696c7 tempest-TestMinimumBasicScenario-2073313970 None] attachment_update completed successfully.
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (2bd035d1-f24b-438c-a871-139e26ac9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0679e5-6156-42f6-966a-b566be9e980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0679e5-6156-42f6-966a-b566be9e980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-587011128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8a3049-183a-4aa9-b5f3-ec57dfb7890f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb354073b18743a982701061c9e9c312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f32c1b4-0865-47e6-97da-683a30a1f457,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:46Z,use_quota=True,user_id='cfdb0d5b771e4ca8a8a71f999ea6e887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d74676-6353-472c-b7b7-6eba6bb55437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d74676-6353-472c-b7b7-6eba6bb55437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736fe8d3-0ca2-4fde-93dc-a15627dc7068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736fe8d3-0ca2-4fde-93dc-a15627dc7068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a8a3049-183a-4aa9-b5f3-ec57dfb7890f', 'volume_name': 'volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f', 'volume_size': 1, 'snapshot_id': '3f32c1b4-0865-47e6-97da-683a30a1f457'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7492803-f5d4-45a1-b5c4-074af34f1dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7492803-f5d4-45a1-b5c4-074af34f1dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d691117-2b6f-41ec-b2e4-ff4e2c4de531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Volume 4a8a3049-183a-4aa9-b5f3-ec57dfb7890f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f', 'volume_size': 1, 'snapshot_id': '3f32c1b4-0865-47e6-97da-683a30a1f457'}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (8dde7c46-1b50-4ec0-8e4a-71d445ee2b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73658d1c-a803-47fa-87f3-d53e1698be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Creating volume 4a8a3049-183a-4aa9-b5f3-ec57dfb7890f from snapshot 3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73658d1c-a803-47fa-87f3-d53e1698be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-318242522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4a66cf-6b70-44d8-9aef-4347be2bb4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:46Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3ed1ec-dad9-4cad-a174-6477b4de660a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3ed1ec-dad9-4cad-a174-6477b4de660a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528513d-cf8a-4467-ad6f-8e6f2fb7e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528513d-cf8a-4467-ad6f-8e6f2fb7e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4a66cf-6b70-44d8-9aef-4347be2bb4d8', 'volume_name': 'volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc22de8-fd14-4c66-84e9-e0d977bbc051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc22de8-fd14-4c66-84e9-e0d977bbc051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd36e85-2c86-448c-91d9-741fef3036f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Volume 4b4a66cf-6b70-44d8-9aef-4347be2bb4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8', 'volume_size': 1}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] snapshot: 3f32c1b4-0865-47e6-97da-683a30a1f457, volume: 4a8a3049-183a-4aa9-b5f3-ec57dfb7890f,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d0260-fb05-40a0-bbec-11b53bfa7dc0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:46 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:24:46 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:47 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 0.902s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2feb16-d5c0-4290-8fec-a435fd73d482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf096a-d3df-4cd9-84ad-3ca8b6936390]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:47 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:24:47 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:48 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 0.850s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:48 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:24:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:48 devstack sudo[95521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f
Jul 06 13:24:48 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:54 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" returned: 0 in 6.389s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4d00f4-ac32-47e8-bee6-9837af07f6fc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:55 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:24:55 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:56 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 1.161s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:24:56 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Converted 1024.00 MB image at 160.25 MB/s
Jul 06 13:24:56 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f is being set with open permissions: ugo+rw
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:56 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f
Jul 06 13:24:56 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=69,cinder:UPDATE=58,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=47,cinder:INSERT=17,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:24:56 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" returned: 0 in 0.853s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" released by "_copy_volume_from_snapshot" :: held 10.288s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" released by "_create_volume_from_snapshot" :: held 10.379s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.438s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.312s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-318242522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4a66cf-6b70-44d8-9aef-4347be2bb4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:24:46Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Creating volume 4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:24:57 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:57 devstack sudo[95560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 1073741824
Jul 06 13:24:57 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d691117-2b6f-41ec-b2e4-ff4e2c4de531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f', 'volume_size': 1, 'snapshot_id': '3f32c1b4-0865-47e6-97da-683a30a1f457'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb56ba3-120b-4aca-9083-94d0abcf1cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:57 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Volume volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f (4a8a3049-183a-4aa9-b5f3-ec57dfb7890f): created successfully
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb56ba3-120b-4aca-9083-94d0abcf1cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Flow 'volume_create_manager' (2bd035d1-f24b-438c-a871-139e26ac9dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6fa100ea-3374-4419-9540-f8ed7817b22e tempest-VolumesDeleteCascade-1561851462 None] Created volume successfully.
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-cb2feb16-d5c0-4290-8fec-a435fd73d482-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-cb2feb16-d5c0-4290-8fec-a435fd73d482-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Performing cascade delete. {{(pid=86698) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-3f32c1b4-0865-47e6-97da-683a30a1f457-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-3f32c1b4-0865-47e6-97da-683a30a1f457-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Deleting offline snapshot 3f32c1b4-0865-47e6-97da-683a30a1f457 of volume cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] snapshot_file for this snap is: volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7ebd65-8545-489c-8628-479a92f06c49]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:58 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:24:58 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:58 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 1073741824" returned: 0 in 1.567s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:58 devstack sudo[95568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8
Jul 06 13:24:58 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:59 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 1.060s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2feb16-d5c0-4290-8fec-a435fd73d482(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fefad77-a235-4969-8da6-2afca638fabd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:24:59 devstack sudo[95573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:24:59 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:24:59 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" returned: 0 in 0.945s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] <== create_volume: return (2578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd36e85-2c86-448c-91d9-741fef3036f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec810e96-2a44-4f01-8eaa-85ed8a054d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:24:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Volume volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 (4b4a66cf-6b70-44d8-9aef-4347be2bb4d8): created successfully
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec810e96-2a44-4f01-8eaa-85ed8a054d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:24:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (8dde7c46-1b50-4ec0-8e4a-71d445ee2b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:24:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c7b0157c-468f-4bf8-8315-360f4cfe054b tempest-AttachVolumeTestJSON-401772845 None] Created volume successfully.
Jul 06 13:25:00 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 1.023s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:00 devstack sudo[95579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:25:00 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:01 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 1.004s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:01 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457
Jul 06 13:25:01 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:02 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482.3f32c1b4-0865-47e6-97da-683a30a1f457" returned: 0 in 0.822s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-3f32c1b4-0865-47e6-97da-683a30a1f457" released by "_delete_snapshot" :: held 4.060s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" released by "delete_snapshot" :: held 4.097s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['16a05c1a-3b4c-4bf7-b5e5-de9abae7e434', 'f5acecb7-0b57-4487-badb-d2889dee632d', '3a9ff3d6-379f-4f5f-b0c3-5d2926f0a1f0', '639720b0-bcf6-4273-a7e5-2677d8eee925'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Delete snapshot completed successfully.
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-3f32c1b4-0865-47e6-97da-683a30a1f457-delete_snapshot" released by "delete_snapshot" :: held 4.275s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Snapshots deleted, issuing volume delete {{(pid=86698) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f431fb-9a3d-4344-9f4a-4dd4fc5a1027]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:02 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:25:02 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:03 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 0.927s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:03 devstack sudo[95612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482
Jul 06 13:25:03 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb875fd8-a0c0-4092-a628-15f0d63e798f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:03 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8
Jul 06 13:25:03 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:04 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cb2feb16-d5c0-4290-8fec-a435fd73d482" returned: 0 in 0.963s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-cb2feb16-d5c0-4290-8fec-a435fd73d482" released by "delete_volume" :: held 1.967s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['39ade116-e2a7-46e9-9a5a-946a86443278', 'b1ae9fc5-0f67-4e9b-92a7-e94e3befb1a1', 'bbf60ab5-85a7-4697-be1f-7e0e53a10af0', '322536fe-4d34-4e68-a535-8e72b1b89793'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:04 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:04 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:04 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" returned: 0 in 1.201s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.228s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1057e243-8c7b-41f8-b7eb-d1fe282954e2', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:25:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-e52fe214-bace-4f53-b019-c737373acdc4 req-9b7a1269-84d1-48f0-bcc2-7729c5f6afbc tempest-AttachVolumeTestJSON-401772845 None] attachment_update completed successfully.
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b02c5f-4e1c-4fac-b552-99825031bfc3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:05 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f
Jul 06 13:25:05 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:05 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Deleted volume successfully.
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4829dc4-bc17-4ce8-8649-4c5da8e6fdf9 tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-cb2feb16-d5c0-4290-8fec-a435fd73d482-delete_volume" released by "delete_volume" :: held 7.500s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:05 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" returned: 0 in 0.919s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:05 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f
Jul 06 13:25:05 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:06 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" returned: 0 in 0.721s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-quobyte-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f" released by "delete_volume" :: held 1.706s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Created reservations ['0aacb056-ea11-469c-b200-c1e99f2146d5', 'd5f506e4-7789-4349-a8f5-163398c76aec', '573d5433-160b-4438-9f8d-d0cd25d07769', '3704f11c-7dae-4024-872b-818acb500d32'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:06 devstack sudo[96025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:06 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:07 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.738s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:07 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Deleted volume successfully.
Jul 06 13:25:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-229e1447-95d6-4078-b2d2-e38a37238fca tempest-VolumesDeleteCascade-1561851462 None] Lock "cinder-4a8a3049-183a-4aa9-b5f3-ec57dfb7890f-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (af1e2b75-f30b-4b0c-8302-535cf4395e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97393bc8-dc51-4b38-9d47-110cb5c150b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97393bc8-dc51-4b38-9d47-110cb5c150b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-300993157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6b4120-cf30-4d9c-9aef-e44578b165bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:09Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d20e709-2bd9-443d-b943-3ae932698dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d20e709-2bd9-443d-b943-3ae932698dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc5aeaf-6ab2-4c67-9379-72ab9c2839a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc5aeaf-6ab2-4c67-9379-72ab9c2839a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6b4120-cf30-4d9c-9aef-e44578b165bd', 'volume_name': 'volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cac7a0-134f-4e16-947e-5bf2142dff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cac7a0-134f-4e16-947e-5bf2142dff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf67a489-7e80-48bb-a78a-d7fa3a2cecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Volume bd6b4120-cf30-4d9c-9aef-e44578b165bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd', 'volume_size': 1}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-300993157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6b4120-cf30-4d9c-9aef-e44578b165bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9f0795bfc1422d8067c900e61b3efa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:09Z,use_quota=True,user_id='e54df02c63c14d679e060aaa6f74815c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Creating volume bd6b4120-cf30-4d9c-9aef-e44578b165bd {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:25:09 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:25:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:09 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd 1073741824
Jul 06 13:25:09 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:10 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd 1073741824" returned: 0 in 1.267s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:10 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd
Jul 06 13:25:10 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Flow 'volume_create_manager' (984b8e6e-46a5-42d3-9847-4c8cca856ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3720f4f9-5909-41b9-8a9a-53618fe467bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3720f4f9-5909-41b9-8a9a-53618fe467bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1028277941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c609b7-74e6-46d6-8c24-98f5aa27146b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01cb5dc59a948b09c602418ecea4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:12Z,use_quota=True,user_id='41c1e37276ea4cca9f55fe394a53f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83897384-cb6e-49fa-90ec-1a8ac82906ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83897384-cb6e-49fa-90ec-1a8ac82906ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018fd0e8-6ce4-40f3-81e7-1cae0fac3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018fd0e8-6ce4-40f3-81e7-1cae0fac3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c609b7-74e6-46d6-8c24-98f5aa27146b', 'volume_name': 'volume-32c609b7-74e6-46d6-8c24-98f5aa27146b', 'volume_size': 2}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5111c636-1942-4b91-9b2f-38d7269bffc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5111c636-1942-4b91-9b2f-38d7269bffc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055facfc-5dfa-4397-9241-2e42411f2ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Volume 32c609b7-74e6-46d6-8c24-98f5aa27146b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c609b7-74e6-46d6-8c24-98f5aa27146b', 'volume_size': 2}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:12 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd" returned: 0 in 1.220s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.546s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1028277941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c609b7-74e6-46d6-8c24-98f5aa27146b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01cb5dc59a948b09c602418ecea4b4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:12Z,use_quota=True,user_id='41c1e37276ea4cca9f55fe394a53f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Creating volume 32c609b7-74e6-46d6-8c24-98f5aa27146b {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:25:12 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b 2147483648 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf67a489-7e80-48bb-a78a-d7fa3a2cecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack sudo[96065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b 2147483648
Jul 06 13:25:12 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0ac279-76dd-4ee8-aebf-122527e707af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:12 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Volume volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd (bd6b4120-cf30-4d9c-9aef-e44578b165bd): created successfully
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0ac279-76dd-4ee8-aebf-122527e707af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Flow 'volume_create_manager' (af1e2b75-f30b-4b0c-8302-535cf4395e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c87a8a77-7126-46b5-8e51-06dd4a6ecbf6 tempest-AttachVolumeTestJSON-401772845 None] Created volume successfully.
Jul 06 13:25:13 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b 2147483648" returned: 0 in 1.209s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:13 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b
Jul 06 13:25:13 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:14 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055facfc-5dfa-4397-9241-2e42411f2ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c609b7-74e6-46d6-8c24-98f5aa27146b', 'volume_size': 2}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5005eeee-c215-4c39-841c-0aac66007498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:14 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Volume volume-32c609b7-74e6-46d6-8c24-98f5aa27146b (32c609b7-74e6-46d6-8c24-98f5aa27146b): created successfully
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5005eeee-c215-4c39-841c-0aac66007498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Flow 'volume_create_manager' (984b8e6e-46a5-42d3-9847-4c8cca856ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-dcf758b4-3c29-42b9-a747-19d900d0ae74 tempest-VolumesCloneNegativeTest-567131455 None] Created volume successfully.
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Acquiring lock "cinder-32c609b7-74e6-46d6-8c24-98f5aa27146b-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "cinder-32c609b7-74e6-46d6-8c24-98f5aa27146b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Acquiring lock "cinder-quobyte-32c609b7-74e6-46d6-8c24-98f5aa27146b" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "cinder-quobyte-32c609b7-74e6-46d6-8c24-98f5aa27146b" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1158457b-f0ac-42b8-b9ed-fa82ef262e14]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:15 devstack sudo[96080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b
Jul 06 13:25:15 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b9da89-325d-4362-b164-a0b7152b5ca2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:16 devstack sudo[96176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd
Jul 06 13:25:16 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:17 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b" returned: 0 in 1.396s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:17 devstack sudo[96185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b
Jul 06 13:25:17 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:17 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd" returned: 0 in 1.427s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.448s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae3327a6-2ccf-4bc8-a327-5e3ab6051ad8', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:25:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-151f27c5-ad84-48d6-9158-30ca3ec2d892 req-3ca3d735-e6e4-41ac-b99e-7fc300ee120d tempest-AttachVolumeTestJSON-401772845 None] attachment_update completed successfully.
Jul 06 13:25:18 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-32c609b7-74e6-46d6-8c24-98f5aa27146b" returned: 0 in 0.968s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "cinder-quobyte-32c609b7-74e6-46d6-8c24-98f5aa27146b" released by "delete_volume" :: held 2.414s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Created reservations ['73b21786-4dd4-4813-8850-9fb3142bd6dd', '0f247a19-5dbf-4aa8-b21f-049c875e6ac1', 'fa468e3d-ef9b-4168-908b-b5849b4f10a2', 'd400a8e0-af02-4620-afbc-704d6a3c4482'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:18 devstack sudo[96194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:18 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:18 devstack sudo[96196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:18 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:19 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.991s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Deleted volume successfully.
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1555b86e-09f6-41ff-b46a-a481e7950d83 tempest-VolumesCloneNegativeTest-567131455 None] Lock "cinder-32c609b7-74e6-46d6-8c24-98f5aa27146b-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:19 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.163s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:25:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (707a901b-5919-4014-a8f5-6e2f6e13dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c70deb-f2ce-4fcd-a610-d01a26c80235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c70deb-f2ce-4fcd-a610-d01a26c80235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967807811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c131bb-f009-4d01-a0c7-65cd6105e773,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:23Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c829b41-428d-449c-88b3-cb737bc51ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c829b41-428d-449c-88b3-cb737bc51ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33f7c76-6b23-41bf-ae46-a7927c0246d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33f7c76-6b23-41bf-ae46-a7927c0246d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c131bb-f009-4d01-a0c7-65cd6105e773', 'volume_name': 'volume-f7c131bb-f009-4d01-a0c7-65cd6105e773', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4005b1be-c875-4478-964d-7ff62f84fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4005b1be-c875-4478-964d-7ff62f84fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be75e6cf-ddb7-4e4d-945b-2f154dea83eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Volume f7c131bb-f009-4d01-a0c7-65cd6105e773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c131bb-f009-4d01-a0c7-65cd6105e773', 'volume_size': 1}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967807811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c131bb-f009-4d01-a0c7-65cd6105e773,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:23Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Creating volume f7c131bb-f009-4d01-a0c7-65cd6105e773 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:25:23 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:25:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:23 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 1073741824
Jul 06 13:25:23 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:24 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 1073741824" returned: 0 in 0.883s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:24 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773
Jul 06 13:25:24 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-b2c241f9-8da0-47fb-b383-bc420a0625ef req-85f259d7-9a8d-4833-9311-75ceba239185 tempest-AttachVolumeTestJSON-401772845 None] Terminate volume connection completed successfully.
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-b2c241f9-8da0-47fb-b383-bc420a0625ef req-85f259d7-9a8d-4833-9311-75ceba239185 tempest-AttachVolumeTestJSON-401772845 None] Deleting attachment 1057e243-8c7b-41f8-b7eb-d1fe282954e2. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:25:25 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773" returned: 0 in 0.769s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be75e6cf-ddb7-4e4d-945b-2f154dea83eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c131bb-f009-4d01-a0c7-65cd6105e773', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1fffe4-948d-45fb-a70a-967ba8bb8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Volume volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 (f7c131bb-f009-4d01-a0c7-65cd6105e773): created successfully
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1fffe4-948d-45fb-a70a-967ba8bb8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (707a901b-5919-4014-a8f5-6e2f6e13dce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0ff3d561-bde1-4d09-a5d6-21280007e20e tempest-VolumesListTestJSON-1027333596 None] Created volume successfully.
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (8b411836-66b0-4b4b-836e-d10e2367a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd4d72a-e7e0-4ad9-a9fc-8d338870ae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd4d72a-e7e0-4ad9-a9fc-8d338870ae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-819660966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f717c5e-f409-4c76-980d-96e04bf0a8dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:27Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb0df08-abbf-47fc-9d25-4a2188dc239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb0df08-abbf-47fc-9d25-4a2188dc239f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911c07e0-7302-4ca5-81f0-5b9c26aa8328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911c07e0-7302-4ca5-81f0-5b9c26aa8328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f717c5e-f409-4c76-980d-96e04bf0a8dc', 'volume_name': 'volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d16b49-7a13-4de0-a055-55ff12e46fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d16b49-7a13-4de0-a055-55ff12e46fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfa707a-c3d5-4298-b472-b6755e73a935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Volume 6f717c5e-f409-4c76-980d-96e04bf0a8dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc', 'volume_size': 1}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-819660966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f717c5e-f409-4c76-980d-96e04bf0a8dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:27Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Creating volume 6f717c5e-f409-4c76-980d-96e04bf0a8dc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:25:27 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:27 devstack sudo[96226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc 1073741824
Jul 06 13:25:27 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-682a2070-da38-4359-8c5c-33e98e23687f req-0629332c-c843-4afd-8587-f203a354e296 tempest-AttachVolumeTestJSON-401772845 None] Terminate volume connection completed successfully.
Jul 06 13:25:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-682a2070-da38-4359-8c5c-33e98e23687f req-0629332c-c843-4afd-8587-f203a354e296 tempest-AttachVolumeTestJSON-401772845 None] Deleting attachment ae3327a6-2ccf-4bc8-a327-5e3ab6051ad8. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:25:28 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc 1073741824" returned: 0 in 1.050s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:28 devstack sudo[96236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc
Jul 06 13:25:28 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:28 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc" returned: 0 in 0.663s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfa707a-c3d5-4298-b472-b6755e73a935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fe729e-2e60-4736-8e85-4daa5310af84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Volume volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc (6f717c5e-f409-4c76-980d-96e04bf0a8dc): created successfully
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79fe729e-2e60-4736-8e85-4daa5310af84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (8b411836-66b0-4b4b-836e-d10e2367a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f5a1652a-6ad8-4ecb-ae63-9237fda25323 tempest-VolumesListTestJSON-1027333596 None] Created volume successfully.
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (2d9bcfb3-fb74-478c-b0b2-4b7a7bcea16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb13e657-b559-443b-aa8d-7288977b04aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb13e657-b559-443b-aa8d-7288977b04aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62860410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292851d1-ac33-472b-bdfd-be39401ad551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:30Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d1012b-9aa1-43f7-8df0-5ed7d77832f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d1012b-9aa1-43f7-8df0-5ed7d77832f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c7fc2-4cd0-4d1c-b77b-1ee2fde441cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c7fc2-4cd0-4d1c-b77b-1ee2fde441cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292851d1-ac33-472b-bdfd-be39401ad551', 'volume_name': 'volume-292851d1-ac33-472b-bdfd-be39401ad551', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd947090-24de-4b50-89e1-981b193b5cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd947090-24de-4b50-89e1-981b193b5cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3813164b-2d9d-4542-9d80-41ac494a40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Volume 292851d1-ac33-472b-bdfd-be39401ad551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292851d1-ac33-472b-bdfd-be39401ad551', 'volume_size': 1}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-62860410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292851d1-ac33-472b-bdfd-be39401ad551,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aa41ee2a31b14ce984d86143e01d25a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:25:30Z,use_quota=True,user_id='e7ce04f2bf864114b90fc118a38e1a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Creating volume 292851d1-ac33-472b-bdfd-be39401ad551 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:25:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:25:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:30 devstack sudo[96239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 1073741824
Jul 06 13:25:30 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:31 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 1073741824" returned: 0 in 1.217s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:31 devstack sudo[96251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551
Jul 06 13:25:31 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:32 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551" returned: 0 in 0.965s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3813164b-2d9d-4542-9d80-41ac494a40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292851d1-ac33-472b-bdfd-be39401ad551', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64125122-fc5c-42c8-9c32-b2bed6f79a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:25:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Volume volume-292851d1-ac33-472b-bdfd-be39401ad551 (292851d1-ac33-472b-bdfd-be39401ad551): created successfully
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64125122-fc5c-42c8-9c32-b2bed6f79a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:25:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Flow 'volume_create_manager' (2d9bcfb3-fb74-478c-b0b2-4b7a7bcea16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:25:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-02916293-f5c0-435e-8fa1-22c32d6d607c tempest-VolumesListTestJSON-1027333596 None] Created volume successfully.
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-292851d1-ac33-472b-bdfd-be39401ad551-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-292851d1-ac33-472b-bdfd-be39401ad551-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-quobyte-292851d1-ac33-472b-bdfd-be39401ad551" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-292851d1-ac33-472b-bdfd-be39401ad551" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384133d-b403-446a-887e-136f4a3b3d9d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:36 devstack sudo[96280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551
Jul 06 13:25:36 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:37 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551" returned: 0 in 0.977s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:37 devstack sudo[96288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551
Jul 06 13:25:37 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:38 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-292851d1-ac33-472b-bdfd-be39401ad551" returned: 0 in 1.015s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-292851d1-ac33-472b-bdfd-be39401ad551" released by "delete_volume" :: held 2.041s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Created reservations ['e355bb5c-6363-4025-9590-926ecdeac81f', '98e268bc-11b5-42fe-a071-758e630f4e72', '6f14b9b8-363f-4e88-93b7-da18cf23432e', 'b4d270c7-2869-4a91-8d36-4858d5642b51'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:38 devstack sudo[96292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:38 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-d83bd4b0-8018-4802-9da2-a8db1492ef7c req-3c3ec1b5-d7fd-4611-b409-08e6f0f1d4db tempest-TestMinimumBasicScenario-2073313970 None] Terminate volume connection completed successfully.
Jul 06 13:25:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-d83bd4b0-8018-4802-9da2-a8db1492ef7c req-3c3ec1b5-d7fd-4611-b409-08e6f0f1d4db tempest-TestMinimumBasicScenario-2073313970 None] Deleting attachment 3062e579-acdf-48f4-ab2a-86caeb4ec0ea. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:25:39 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.923s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Deleted volume successfully.
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bf2cd0c-b55f-4086-ac96-61924f7eb4ed tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-292851d1-ac33-472b-bdfd-be39401ad551-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-6f717c5e-f409-4c76-980d-96e04bf0a8dc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-6f717c5e-f409-4c76-980d-96e04bf0a8dc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-quobyte-6f717c5e-f409-4c76-980d-96e04bf0a8dc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-6f717c5e-f409-4c76-980d-96e04bf0a8dc" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[00115703-2448-49f0-8b00-6f1f0826df13]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:40 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc
Jul 06 13:25:40 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:40 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc" returned: 0 in 0.950s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:40 devstack sudo[96307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc
Jul 06 13:25:40 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "cinder-f82e90d4-ccdc-46f0-a159-2b5803c2e909-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "cinder-f82e90d4-ccdc-46f0-a159-2b5803c2e909-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "cinder-quobyte-f82e90d4-ccdc-46f0-a159-2b5803c2e909" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "cinder-quobyte-f82e90d4-ccdc-46f0-a159-2b5803c2e909" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[befed516-a0ac-4b19-a947-02296a5a5520]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:41 devstack sudo[96309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909
Jul 06 13:25:41 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-bd6b4120-cf30-4d9c-9aef-e44578b165bd-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:41 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6f717c5e-f409-4c76-980d-96e04bf0a8dc" returned: 0 in 0.952s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-6f717c5e-f409-4c76-980d-96e04bf0a8dc" released by "delete_volume" :: held 1.964s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-bd6b4120-cf30-4d9c-9aef-e44578b165bd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-quobyte-bd6b4120-cf30-4d9c-9aef-e44578b165bd" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-bd6b4120-cf30-4d9c-9aef-e44578b165bd" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Created reservations ['c9f673fc-b36d-4bc1-b341-7b94f99fba63', '612fe7a1-63ee-4d50-9a30-9c1e65135201', '09df3f9b-a548-4d63-a8f7-3d0ee5db7f1a', '035d71f8-3978-4917-bbca-07c32b8d5e81'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084e5d3-6b6f-4e7b-b8ee-f92a4c3f9354]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:42 devstack sudo[96316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:42 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:42 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909" returned: 0 in 1.010s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:42 devstack sudo[96315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd
Jul 06 13:25:42 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:42 devstack sudo[96319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909
Jul 06 13:25:42 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-f7c131bb-f009-4d01-a0c7-65cd6105e773-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-f7c131bb-f009-4d01-a0c7-65cd6105e773-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "cinder-quobyte-f7c131bb-f009-4d01-a0c7-65cd6105e773" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-f7c131bb-f009-4d01-a0c7-65cd6105e773" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad08ddaf-c1f0-4130-8145-bbcbfd268f67]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:42 devstack sudo[96323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773
Jul 06 13:25:42 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:43 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Deleted volume successfully.
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6b6b4ecc-cfa1-4f59-9803-dc927a3c9f55 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-6f717c5e-f409-4c76-980d-96e04bf0a8dc-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:43 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f82e90d4-ccdc-46f0-a159-2b5803c2e909" returned: 0 in 1.121s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "cinder-quobyte-f82e90d4-ccdc-46f0-a159-2b5803c2e909" released by "delete_volume" :: held 2.198s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:43 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd" returned: 0 in 1.365s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:43 devstack sudo[96330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd
Jul 06 13:25:43 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Created reservations ['3d2f5640-c714-4659-ac47-88d229af7f0e', 'f42cc7cb-5ee5-4f32-8565-144ee9d63288', '58fbbfad-cf06-4c84-ac96-80860bbc45fd', 'd1ecbf56-d854-4c32-b2bc-409fd32e2188'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:43 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:43 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:43 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773" returned: 0 in 1.069s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:43 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773
Jul 06 13:25:43 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:44 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bd6b4120-cf30-4d9c-9aef-e44578b165bd" returned: 0 in 0.724s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-bd6b4120-cf30-4d9c-9aef-e44578b165bd" released by "delete_volume" :: held 2.147s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Created reservations ['4f0f3791-4b77-4a75-b819-0ef3fe8179f5', 'd33567ef-06df-46fe-bfba-483b56707359', '0f17d9fd-f223-46b6-ab3f-e4ee5975e2c7', '44c989d3-ce73-4354-9982-53ec5c5ad45e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:44 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.888s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:44 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:44 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Deleted volume successfully.
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4af5558f-e3a2-4759-8105-023545b52f15 tempest-TestMinimumBasicScenario-2073313970 None] Lock "cinder-f82e90d4-ccdc-46f0-a159-2b5803c2e909-delete_volume" released by "delete_volume" :: held 3.402s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:44 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7c131bb-f009-4d01-a0c7-65cd6105e773" returned: 0 in 0.893s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-quobyte-f7c131bb-f009-4d01-a0c7-65cd6105e773" released by "delete_volume" :: held 2.074s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Created reservations ['bfed871c-fbdc-447e-bd16-b4dfa771ab91', 'bc361a28-5c47-4288-b11a-213aa70fb084', '2f059cdf-be2e-4fe5-837d-a7844b0bb18f', '92c13e15-c692-4af3-8838-85846a673e80'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:44 devstack sudo[96345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:44 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:45 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.974s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Deleted volume successfully.
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3b88f8b9-f7da-4785-aeea-14c2f7e03cf4 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-bd6b4120-cf30-4d9c-9aef-e44578b165bd-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-quobyte-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" acquired by "delete_volume" :: waited 0.047s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1628964b-f03d-4ba0-b252-96e1f10085ca]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:45 devstack sudo[96350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8
Jul 06 13:25:45 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:46 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.180s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Deleted volume successfully.
Jul 06 13:25:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e9ec13f-2f19-417a-b952-3042c29745d4 tempest-VolumesListTestJSON-1027333596 None] Lock "cinder-f7c131bb-f009-4d01-a0c7-65cd6105e773-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:47 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" returned: 0 in 1.502s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:47 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8
Jul 06 13:25:47 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:48 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" returned: 0 in 0.844s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8" released by "delete_volume" :: held 2.458s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Created reservations ['1052240f-17aa-44ba-8a71-a5c5e7cd2b83', 'bafefda7-480d-4d54-be5b-11422cbbb121', 'a99caf02-742b-463b-8f00-0fd31f33bc2b', '5de24e7e-ac88-4195-9777-c2ae3d531782'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:48 devstack sudo[96397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:48 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-9c9a8258-3fc2-44d9-ba68-36450a161bdb-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-9c9a8258-3fc2-44d9-ba68-36450a161bdb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "cinder-quobyte-9c9a8258-3fc2-44d9-ba68-36450a161bdb" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:25:49 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.032s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-9c9a8258-3fc2-44d9-ba68-36450a161bdb" acquired by "delete_volume" :: waited 0.055s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:25:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Deleted volume successfully.
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b906329c-a8bb-4648-9e7f-b20b1d9b27ef]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-541883ff-6016-4f4d-8993-fbacf2f4ea47 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-4b4a66cf-6b70-44d8-9aef-4347be2bb4d8-delete_volume" released by "delete_volume" :: held 3.906s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:49 devstack sudo[96401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb
Jul 06 13:25:49 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:50 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb" returned: 0 in 0.867s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:50 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb
Jul 06 13:25:50 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:51 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9c9a8258-3fc2-44d9-ba68-36450a161bdb" returned: 0 in 1.030s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-quobyte-9c9a8258-3fc2-44d9-ba68-36450a161bdb" released by "delete_volume" :: held 1.979s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Created reservations ['7bd3ff7b-f12e-45b1-9c84-93ef14811698', '049875d3-3745-4238-ad49-6a553981a100', 'e9beae28-9214-4d82-a6cd-3b6edc02810c', 'e91ba5ae-cc29-40eb-a1d2-9cfb25bdf842'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:25:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:25:51 devstack sudo[96453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:25:51 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:25:52 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root
Jul 06 13:25:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:25:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:25:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Deleted volume successfully.
Jul 06 13:25:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e76c5d9-9b0f-4a86-8a3b-1f72737ba367 tempest-AttachVolumeTestJSON-401772845 None] Lock "cinder-9c9a8258-3fc2-44d9-ba68-36450a161bdb-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:01 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=100,cinder:DELETE=9,cinder:SELECT=86,cinder:INSERT=27 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (17563212-5b63-43c5-ad37-b3619943749a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2c716-b754-4a47-b683-6bb78366b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=78,cinder:UPDATE=116,cinder:DELETE=8,cinder:INSERT=23 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba2c716-b754-4a47-b683-6bb78366b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568447172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f90a96-4bce-438c-8b98-979b883dcebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:02Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904df81c-011a-4731-b6c0-6906cef755f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904df81c-011a-4731-b6c0-6906cef755f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bbe79e-3415-404b-82e8-a20a0ef2dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21bbe79e-3415-404b-82e8-a20a0ef2dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f90a96-4bce-438c-8b98-979b883dcebc', 'volume_name': 'volume-76f90a96-4bce-438c-8b98-979b883dcebc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7050dd2f-36cd-4840-9933-0daf3bb9537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7050dd2f-36cd-4840-9933-0daf3bb9537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e9811a-158d-47fa-9537-ed2164899024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Volume 76f90a96-4bce-438c-8b98-979b883dcebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f90a96-4bce-438c-8b98-979b883dcebc', 'volume_size': 1}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1568447172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f90a96-4bce-438c-8b98-979b883dcebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:02Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Creating volume 76f90a96-4bce-438c-8b98-979b883dcebc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:02 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:02 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc 1073741824
Jul 06 13:26:02 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:04 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc 1073741824" returned: 0 in 1.927s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:04 devstack sudo[96510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc
Jul 06 13:26:04 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:05 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc" returned: 0 in 1.182s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] <== create_volume: return (3189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.192s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e9811a-158d-47fa-9537-ed2164899024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f90a96-4bce-438c-8b98-979b883dcebc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2427ef-7441-4e78-892c-272717bd2a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Volume volume-76f90a96-4bce-438c-8b98-979b883dcebc (76f90a96-4bce-438c-8b98-979b883dcebc): created successfully
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2427ef-7441-4e78-892c-272717bd2a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (17563212-5b63-43c5-ad37-b3619943749a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-251605e8-ee10-446d-8bd3-4b739e4ee969 tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:26:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d1db404d-0093-47c4-b828-4642d208169d tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc" by "attach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d1db404d-0093-47c4-b828-4642d208169d tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc" acquired by "attach_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d1db404d-0093-47c4-b828-4642d208169d tempest-VolumesActionsTest-765506224 None] Attaching volume 76f90a96-4bce-438c-8b98-979b883dcebc to instance c80fde09-e549-45f7-8e4d-37b7f3c96640 at mountpoint /dev/vdb on host None.
Jul 06 13:26:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d1db404d-0093-47c4-b828-4642d208169d tempest-VolumesActionsTest-765506224 None] Attach volume completed successfully.
Jul 06 13:26:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d1db404d-0093-47c4-b828-4642d208169d tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc" released by "attach_volume" :: held 0.257s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Terminate volume connection completed successfully.
Jul 06 13:26:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" by "detach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Detaching volume 76f90a96-4bce-438c-8b98-979b883dcebc from instance c80fde09-e549-45f7-8e4d-37b7f3c96640.
Jul 06 13:26:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Detach volume completed successfully.
Jul 06 13:26:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0a057a84-4121-45f1-9e15-20196bea4f92 tempest-VolumesActionsTest-268430972 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b873ffe9-4da8-48e8-8628-56767b82d312 tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" by "detach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b873ffe9-4da8-48e8-8628-56767b82d312 tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b873ffe9-4da8-48e8-8628-56767b82d312 tempest-VolumesActionsTest-765506224 None] Volume detach called, but volume not attached.
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b873ffe9-4da8-48e8-8628-56767b82d312 tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-quobyte-76f90a96-4bce-438c-8b98-979b883dcebc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "cinder-quobyte-76f90a96-4bce-438c-8b98-979b883dcebc" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c6ee7-c337-4916-887e-9920092c5aac]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:10 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc
Jul 06 13:26:10 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:11 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc" returned: 0 in 1.173s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:11 devstack sudo[96576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc
Jul 06 13:26:11 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:12 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-76f90a96-4bce-438c-8b98-979b883dcebc" returned: 0 in 0.796s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "cinder-quobyte-76f90a96-4bce-438c-8b98-979b883dcebc" released by "delete_volume" :: held 2.039s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Created reservations ['dc41a5a1-dec0-4f66-b1ae-1cd6b5c13196', 'aed3ef9b-21dc-4ab2-8791-968c69bc2663', '2e83d1e5-f68a-4c21-b34a-d22e8d9d1ec5', '7775e48e-6222-4404-a103-028cb23665ce'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:12 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:26:12 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (e8accd1d-32fb-436e-a695-8c685a26f70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627bff66-e568-47af-b440-4746da9f66e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627bff66-e568-47af-b440-4746da9f66e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-632543404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c477778-2a58-4441-a9af-a025a48ec935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:12Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588c1d56-6cbb-4a62-a92e-6aa45859a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588c1d56-6cbb-4a62-a92e-6aa45859a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f0fa10-cb4c-44a8-8609-e55512bb83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f0fa10-cb4c-44a8-8609-e55512bb83e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c477778-2a58-4441-a9af-a025a48ec935', 'volume_name': 'volume-3c477778-2a58-4441-a9af-a025a48ec935', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecfdad6-df2b-4b03-bc9e-4ab331cf53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecfdad6-df2b-4b03-bc9e-4ab331cf53e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6204609d-c46d-4ce5-8985-3e9623ae8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:12 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Volume 3c477778-2a58-4441-a9af-a025a48ec935: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c477778-2a58-4441-a9af-a025a48ec935', 'volume_size': 1}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-632543404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c477778-2a58-4441-a9af-a025a48ec935,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:12Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Creating volume 3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:12 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:12 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 1073741824
Jul 06 13:26:12 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:13 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.001s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:13 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:26:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Deleted volume successfully.
Jul 06 13:26:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b516258e-b884-4e85-90b0-596b89faa164 tempest-VolumesActionsTest-765506224 None] Lock "cinder-76f90a96-4bce-438c-8b98-979b883dcebc-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:13 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 1073741824" returned: 0 in 1.362s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:14 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935
Jul 06 13:26:14 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:15 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935" returned: 0 in 1.277s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.784s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6204609d-c46d-4ce5-8985-3e9623ae8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c477778-2a58-4441-a9af-a025a48ec935', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2f8356-47ba-4016-99d8-a8a9f3ed2b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:15 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Volume volume-3c477778-2a58-4441-a9af-a025a48ec935 (3c477778-2a58-4441-a9af-a025a48ec935): created successfully
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2f8356-47ba-4016-99d8-a8a9f3ed2b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (e8accd1d-32fb-436e-a695-8c685a26f70c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-163f7dbc-9ff0-4d44-9b9d-6e58e84f4e4d tempest-VolumesSnapshotTestJSON-921271547 None] Created volume successfully.
Jul 06 13:26:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Creating offline snapshot 29952519-8acb-473f-9b96-e7dde07991ed of volume 3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:26:17 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[19be82f5-d2f7-4b5b-9572-defc694e4902]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:17 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935
Jul 06 13:26:17 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:18 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935" returned: 0 in 1.032s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:18 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed 1G
Jul 06 13:26:18 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:18 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:26:18 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.914s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:26:19 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:26:19 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed 1G" returned: 0 in 1.151s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c477778-2a58-4441-a9af-a025a48ec935 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:19 devstack sudo[96635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c477778-2a58-4441-a9af-a025a48ec935 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed
Jul 06 13:26:19 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:20 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c477778-2a58-4441-a9af-a025a48ec935 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed" returned: 0 in 0.915s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:20 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed is being set with open permissions: ugo+rw
Jul 06 13:26:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:20 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed
Jul 06 13:26:20 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:21 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed" returned: 0 in 0.844s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:21 devstack sudo[96645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info
Jul 06 13:26:21 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:21 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info" returned: 0 in 0.758s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:21 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info is being set with open permissions: ugo+rw
Jul 06 13:26:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:22 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info
Jul 06 13:26:22 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:22 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.info" returned: 0 in 0.782s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.660s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b93d27f1-d054-4a3c-9a41-0c93a260e3fe tempest-VolumesSnapshotTestJSON-921271547 None] Create snapshot completed successfully
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-29952519-8acb-473f-9b96-e7dde07991ed-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-29952519-8acb-473f-9b96-e7dde07991ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-29952519-8acb-473f-9b96-e7dde07991ed" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-29952519-8acb-473f-9b96-e7dde07991ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Deleting offline snapshot 29952519-8acb-473f-9b96-e7dde07991ed of volume 3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] snapshot_file for this snap is: volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b630f36e-77b5-47c7-9a85-b8c152f27020]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:24 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed
Jul 06 13:26:24 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:25 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed" returned: 0 in 1.243s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c477778-2a58-4441-a9af-a025a48ec935(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e23bf41-b7b0-4704-81cb-f93d2acb8e8a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (849229fa-7990-48ea-8675-5f8d98bf461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691b72a-abd2-4c2d-bcf4-6689d06f9d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691b72a-abd2-4c2d-bcf4-6689d06f9d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692213055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b84c43a-1349-45d3-9246-45fd221fb18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:25Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd89cae-c197-41ff-93fe-4428d7996417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd89cae-c197-41ff-93fe-4428d7996417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59a30fd-003a-4f8d-b906-2b401dbe8a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59a30fd-003a-4f8d-b906-2b401dbe8a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b84c43a-1349-45d3-9246-45fd221fb18d', 'volume_name': 'volume-9b84c43a-1349-45d3-9246-45fd221fb18d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1258e2a2-efa9-4480-bc62-6a82f444607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1258e2a2-efa9-4480-bc62-6a82f444607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617ee210-9ab5-49ae-a4fa-a671223d800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Volume 9b84c43a-1349-45d3-9246-45fd221fb18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b84c43a-1349-45d3-9246-45fd221fb18d', 'volume_size': 1}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1692213055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b84c43a-1349-45d3-9246-45fd221fb18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:25Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Creating volume 9b84c43a-1349-45d3-9246-45fd221fb18d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:25 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:25 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d 1073741824
Jul 06 13:26:25 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:25 devstack sudo[96657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935
Jul 06 13:26:25 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:26 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935" returned: 0 in 1.087s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:26 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed
Jul 06 13:26:26 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:26 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d 1073741824" returned: 0 in 1.291s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:26 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d
Jul 06 13:26:26 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:27 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed" returned: 0 in 1.195s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:27 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed
Jul 06 13:26:27 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:27 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d" returned: 0 in 0.966s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617ee210-9ab5-49ae-a4fa-a671223d800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b84c43a-1349-45d3-9246-45fd221fb18d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb3b443-ff3e-4ee6-b854-a47448dc7329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Volume volume-9b84c43a-1349-45d3-9246-45fd221fb18d (9b84c43a-1349-45d3-9246-45fd221fb18d): created successfully
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb3b443-ff3e-4ee6-b854-a47448dc7329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (849229fa-7990-48ea-8675-5f8d98bf461b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3f9aeddc-824c-42d2-ad57-bdbe4a65ffef tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:26:28 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935.29952519-8acb-473f-9b96-e7dde07991ed" returned: 0 in 1.045s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-29952519-8acb-473f-9b96-e7dde07991ed" released by "_delete_snapshot" :: held 4.784s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" released by "delete_snapshot" :: held 4.812s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-9b84c43a-1349-45d3-9246-45fd221fb18d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "cinder-9b84c43a-1349-45d3-9246-45fd221fb18d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['d481079c-842b-4721-b4d4-0259c486e37f', '5aefa855-fd9f-4b92-a155-df4f09aa7842', '1cb653d2-f974-4f17-8fca-c3ccf8cf9cad', '7e1ede65-3685-4019-bb74-003b97c1b4bf'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-quobyte-9b84c43a-1349-45d3-9246-45fd221fb18d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-9b84c43a-1349-45d3-9246-45fd221fb18d" acquired by "delete_volume" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Delete snapshot completed successfully.
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e530dc03-b22f-4aeb-a56b-05cd3e222bda tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-29952519-8acb-473f-9b96-e7dde07991ed-delete_snapshot" released by "delete_snapshot" :: held 5.181s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a93d96-147e-4be4-a08f-1d558d045009]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:29 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d
Jul 06 13:26:29 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (d74bebd9-3ea1-4428-8c93-877b5be6bb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab83ef53-b688-44b2-b546-76078cf8124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab83ef53-b688-44b2-b546-76078cf8124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862664288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab7109e-32c3-49ee-ab43-bb9a05a23784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:30Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879aaf9b-6216-4935-ba8f-4636c998452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879aaf9b-6216-4935-ba8f-4636c998452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6803f2-387a-4d47-baff-8b16ce20c765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6803f2-387a-4d47-baff-8b16ce20c765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab7109e-32c3-49ee-ab43-bb9a05a23784', 'volume_name': 'volume-bab7109e-32c3-49ee-ab43-bb9a05a23784', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0afe6f-b164-4dae-84d2-62e653d8de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0afe6f-b164-4dae-84d2-62e653d8de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbbbe18-fb53-4118-a2a6-5ce028d206c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Volume bab7109e-32c3-49ee-ab43-bb9a05a23784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab7109e-32c3-49ee-ab43-bb9a05a23784', 'volume_size': 1}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862664288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab7109e-32c3-49ee-ab43-bb9a05a23784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:30Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Creating volume bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:30 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d" returned: 0 in 1.423s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:30 devstack sudo[96690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 1073741824
Jul 06 13:26:30 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:30 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d
Jul 06 13:26:30 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:31 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9b84c43a-1349-45d3-9246-45fd221fb18d" returned: 0 in 1.153s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-9b84c43a-1349-45d3-9246-45fd221fb18d" released by "delete_volume" :: held 2.664s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Created reservations ['5e420396-d769-4792-a8de-74e8676da616', 'f261339e-d244-4a7c-9538-b784a94f5854', '978757bd-866f-4d83-8cf0-b144bae0c617', '63d392cd-7f7d-4631-97aa-b946f2fd693f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:31 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 1073741824" returned: 0 in 1.437s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:31 devstack sudo[96701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:26:31 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:31 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:26:31 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:32 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.049s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:26:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Deleted volume successfully.
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a088fc45-8f0b-414a-bd77-235d75aeb3c7 tempest-VolumesActionsTest-268430972 None] Lock "cinder-9b84c43a-1349-45d3-9246-45fd221fb18d-delete_volume" released by "delete_volume" :: held 4.056s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:32 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 1.117s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] <== create_volume: return (2623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.628s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cbbbe18-fb53-4118-a2a6-5ce028d206c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab7109e-32c3-49ee-ab43-bb9a05a23784', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c4308a-8ce8-4c82-801f-a131bca33fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Volume volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 (bab7109e-32c3-49ee-ab43-bb9a05a23784): created successfully
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c4308a-8ce8-4c82-801f-a131bca33fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (d74bebd9-3ea1-4428-8c93-877b5be6bb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-da146dd3-78e1-4046-91bc-b1a747a026c6 tempest-VolumesSnapshotTestJSON-921271547 None] Created volume successfully.
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (8fc0f03f-ab3c-408f-850c-166f4a4d6598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f78191f-ede8-49de-a387-a16c5bda0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f78191f-ede8-49de-a387-a16c5bda0d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1569578641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de01db45-4db7-47bf-a640-2f567def7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:33Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d940e36-8fd1-4347-a8f0-c08b7f5a137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d940e36-8fd1-4347-a8f0-c08b7f5a137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26018f-29ad-4a4b-8ce6-0c74e0db64fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c26018f-29ad-4a4b-8ce6-0c74e0db64fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de01db45-4db7-47bf-a640-2f567def7e9c', 'volume_name': 'volume-de01db45-4db7-47bf-a640-2f567def7e9c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e17f-3497-4f79-b524-8694ec00c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d4e17f-3497-4f79-b524-8694ec00c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a903a1d1-9aeb-4db6-ada6-1211a19dc9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Volume de01db45-4db7-47bf-a640-2f567def7e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de01db45-4db7-47bf-a640-2f567def7e9c', 'volume_size': 1}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1569578641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de01db45-4db7-47bf-a640-2f567def7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:33Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Creating volume de01db45-4db7-47bf-a640-2f567def7e9c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:33 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:33 devstack sudo[96708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c 1073741824
Jul 06 13:26:33 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:34 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c 1073741824" returned: 0 in 1.203s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:34 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c
Jul 06 13:26:34 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:35 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c" returned: 0 in 0.838s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.735s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a903a1d1-9aeb-4db6-ada6-1211a19dc9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de01db45-4db7-47bf-a640-2f567def7e9c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38a629-41b8-441b-b872-7dd455aa91db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Creating offline snapshot 539cafab-628f-4a73-bee2-20af945950ca of volume bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:26:35 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Volume volume-de01db45-4db7-47bf-a640-2f567def7e9c (de01db45-4db7-47bf-a640-2f567def7e9c): created successfully
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f38a629-41b8-441b-b872-7dd455aa91db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (8fc0f03f-ab3c-408f-850c-166f4a4d6598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0d9a68-c3d1-4f51-a81c-f34acd9845c0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c32e5bf7-243c-4b4a-9fd2-7601d4acc1fb tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:26:35 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:26:35 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:36 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 0.947s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:36 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca 1G
Jul 06 13:26:36 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-de01db45-4db7-47bf-a640-2f567def7e9c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "cinder-de01db45-4db7-47bf-a640-2f567def7e9c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-quobyte-de01db45-4db7-47bf-a640-2f567def7e9c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-de01db45-4db7-47bf-a640-2f567def7e9c" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb58cd1e-b608-43ca-a5e9-f0db0612a786]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:36 devstack sudo[96743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c
Jul 06 13:26:36 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:37 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca 1G" returned: 0 in 1.033s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:37 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:26:37 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:37 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c" returned: 0 in 1.250s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:37 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c
Jul 06 13:26:37 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:38 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 0.919s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:38 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca is being set with open permissions: ugo+rw
Jul 06 13:26:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:38 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:26:38 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:38 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-de01db45-4db7-47bf-a640-2f567def7e9c" returned: 0 in 0.842s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-de01db45-4db7-47bf-a640-2f567def7e9c" released by "delete_volume" :: held 2.161s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:38 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Created reservations ['36b609c0-ee55-40d8-b69f-4560f5896340', 'd74b4668-e044-489f-ae3f-3f3f5bf38d3e', 'd9fbadf3-23f1-4867-8ba2-a9e1b1177be1', '419d454c-35dc-4407-a0bd-38efc02690c7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:39 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:26:39 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:39 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 1.200s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:39 devstack sudo[96798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info
Jul 06 13:26:39 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:40 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.404s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:26:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Deleted volume successfully.
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-279af814-2c90-4218-b327-6182fc20694c tempest-VolumesActionsTest-268430972 None] Lock "cinder-de01db45-4db7-47bf-a640-2f567def7e9c-delete_volume" released by "delete_volume" :: held 3.971s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:40 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info" returned: 0 in 0.985s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:40 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info is being set with open permissions: ugo+rw
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:40 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info
Jul 06 13:26:40 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (e26501b7-e025-4c66-96e7-f2c4fa76f661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a94ae-1394-4e07-9a2b-aea58f2aa964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0a94ae-1394-4e07-9a2b-aea58f2aa964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923350550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:41Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8692aeee-f105-45a1-b71b-d358981ff1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8692aeee-f105-45a1-b71b-d358981ff1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0d22eb-bc24-486d-8396-049940d52959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0d22eb-bc24-486d-8396-049940d52959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c', 'volume_name': 'volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2b6f0-3152-4390-9e8d-05235b02a641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cb2b6f0-3152-4390-9e8d-05235b02a641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f090bc9-920e-4406-94cc-07dcedf0a683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:40 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Volume a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c', 'volume_size': 1}
Jul 06 13:26:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:41 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.info" returned: 0 in 0.824s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.121s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-923350550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:41Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Creating volume a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:41 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:41 devstack sudo[96836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c 1073741824
Jul 06 13:26:41 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fddfb4fc-4152-4bcb-be28-73fdd438e60c tempest-VolumesSnapshotTestJSON-921271547 None] Create snapshot completed successfully
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:42 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (f9192933-8aae-4f0c-bd7c-45dd8c6499eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f43b26-08c8-46e2-bb13-b820838ab991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c 1073741824" returned: 0 in 1.334s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f43b26-08c8-46e2-bb13-b820838ab991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-415877413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=611cf920-a201-466a-96e8-361d6cae49cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=539cafab-628f-4a73-bee2-20af945950ca,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:43Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a167917b-1dab-481f-a7fc-4215af9a3d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a167917b-1dab-481f-a7fc-4215af9a3d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4908e9-bc9e-499a-ab76-21467e6bded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4908e9-bc9e-499a-ab76-21467e6bded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '611cf920-a201-466a-96e8-361d6cae49cf', 'volume_name': 'volume-611cf920-a201-466a-96e8-361d6cae49cf', 'volume_size': 2, 'snapshot_id': '539cafab-628f-4a73-bee2-20af945950ca'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895d12e9-5419-4b55-bd2c-3ea3133b172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895d12e9-5419-4b55-bd2c-3ea3133b172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6890aa-7061-4496-a2dc-a22f08f3b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Volume 611cf920-a201-466a-96e8-361d6cae49cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-611cf920-a201-466a-96e8-361d6cae49cf', 'volume_size': 2, 'snapshot_id': '539cafab-628f-4a73-bee2-20af945950ca'}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:42 devstack sudo[96843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c
Jul 06 13:26:42 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:43 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] <== create_volume: return (2191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.778s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca-611cf920-a201-466a-96e8-361d6cae49cf" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f090bc9-920e-4406-94cc-07dcedf0a683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302616a0-19a4-42d5-a09d-46e83130a9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca-611cf920-a201-466a-96e8-361d6cae49cf" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Creating volume 611cf920-a201-466a-96e8-361d6cae49cf from snapshot 539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:43 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Volume volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c (a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c): created successfully
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302616a0-19a4-42d5-a09d-46e83130a9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (e26501b7-e025-4c66-96e7-f2c4fa76f661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" acquired by "_copy_volume_from_snapshot" :: waited 0.073s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] snapshot: 539cafab-628f-4a73-bee2-20af945950ca, volume: 611cf920-a201-466a-96e8-361d6cae49cf,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ff36bf6b-a734-438e-955f-a12e1c996236 tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:26:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a987cdb-049e-4eca-ae56-ad9768ba3809]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:44 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:26:44 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:45 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 1.186s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab7109e-32c3-49ee-ab43-bb9a05a23784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[169612d6-2b09-4985-af52-6ae504c03294]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:45 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:26:45 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "cinder-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-quobyte-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2269957-3616-45cb-bc02-9b01d0a19143]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:45 devstack sudo[96857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c
Jul 06 13:26:45 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:46 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 1.664s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:46 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:26:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:46 devstack sudo[96862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf
Jul 06 13:26:46 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:47 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" returned: 0 in 1.613s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:47 devstack sudo[96867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c
Jul 06 13:26:47 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:48 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" returned: 0 in 1.589s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c" released by "delete_volume" :: held 3.293s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Created reservations ['c189875d-bbbc-4587-94c4-8637c99c2a97', 'ace20be5-d08c-4712-9ded-3b6d8b49ea07', '1bc607b1-c389-489d-b8af-2669f6b31757', '3ef694f3-8666-40a5-8850-181a4308c7e9'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:49 devstack sudo[96882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:26:49 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:52 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.711s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:26:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Deleted volume successfully.
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cba34f5c-ba34-42f9-adad-844da94a1cdc tempest-VolumesActionsTest-268430972 None] Lock "cinder-a8bb1527-01e6-4fd0-9f6b-2f3581a6f32c-delete_volume" released by "delete_volume" :: held 7.115s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (79472aee-cfc9-472f-ba24-6c7c7c21b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fbdf9f-b641-473b-b2ef-40880fb0d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5fbdf9f-b641-473b-b2ef-40880fb0d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170558242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202e3cfe-2172-49da-859b-97fb0aa9878f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:53Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197dc2b-d570-4054-81aa-b83c60520edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1197dc2b-d570-4054-81aa-b83c60520edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5043652-493d-4506-ae87-21e5a008f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5043652-493d-4506-ae87-21e5a008f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202e3cfe-2172-49da-859b-97fb0aa9878f', 'volume_name': 'volume-202e3cfe-2172-49da-859b-97fb0aa9878f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a147a8-f9f8-4c20-bfb0-80962d74abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a147a8-f9f8-4c20-bfb0-80962d74abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac71d25-68de-4531-b6a3-662d260e356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:52 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Volume 202e3cfe-2172-49da-859b-97fb0aa9878f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202e3cfe-2172-49da-859b-97fb0aa9878f', 'volume_size': 1}
Jul 06 13:26:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:55 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf" returned: 0 in 8.521s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:55 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4f204d-5c61-4001-8c9d-a84318366f11]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:55 devstack sudo[96886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:26:55 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:56 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 1.215s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:56 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784, size 1024.00 MB, duration 8.52 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:26:56 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Converted 1024.00 MB image at 120.16 MB/s
Jul 06 13:26:56 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf is being set with open permissions: ugo+rw
Jul 06 13:26:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:56 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf
Jul 06 13:26:56 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:57 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" released by "_copy_volume_from_snapshot" :: held 13.629s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca-611cf920-a201-466a-96e8-361d6cae49cf" released by "_create_volume_from_snapshot" :: held 13.732s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.784s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.530s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1170558242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202e3cfe-2172-49da-859b-97fb0aa9878f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:53Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Creating volume 202e3cfe-2172-49da-859b-97fb0aa9878f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:26:57 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:57 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f 1073741824
Jul 06 13:26:57 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6890aa-7061-4496-a2dc-a22f08f3b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-611cf920-a201-466a-96e8-361d6cae49cf', 'volume_size': 2, 'snapshot_id': '539cafab-628f-4a73-bee2-20af945950ca'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2b20e-c6e2-4c54-b090-5e8e9fe068a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:57 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Volume volume-611cf920-a201-466a-96e8-361d6cae49cf (611cf920-a201-466a-96e8-361d6cae49cf): created successfully
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c2b20e-c6e2-4c54-b090-5e8e9fe068a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (f9192933-8aae-4f0c-bd7c-45dd8c6499eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2076cd8f-cc7e-42f4-8c83-abb218e3068f tempest-VolumesSnapshotTestJSON-921271547 None] Created volume successfully.
Jul 06 13:26:58 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f 1073741824" returned: 0 in 1.177s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:58 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f
Jul 06 13:26:58 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-611cf920-a201-466a-96e8-361d6cae49cf-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-611cf920-a201-466a-96e8-361d6cae49cf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:26:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6fb06-c800-427e-ba74-565e87d522cb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Flow 'volume_create_manager' (a8aeb634-d36b-4d5c-96f7-dd70613d6370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ee802-f840-41f1-8feb-56c90e005cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca4ee802-f840-41f1-8feb-56c90e005cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-192058242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18ebd0d-66e6-48c5-b961-773ca154ee35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0278b54f897447cb37ae9cfefa623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:59Z,use_quota=True,user_id='7d17e077f9974a4c88f256747cd7a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b9a485-f31d-4145-89cf-3ee0e570aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b9a485-f31d-4145-89cf-3ee0e570aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fd5e10-e401-4956-936c-0f7974aaacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:26:59 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf
Jul 06 13:26:59 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:26:59 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f" returned: 0 in 0.889s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac71d25-68de-4531-b6a3-662d260e356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202e3cfe-2172-49da-859b-97fb0aa9878f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874b4004-b3db-4e0c-a48d-8146414e1085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Volume volume-202e3cfe-2172-49da-859b-97fb0aa9878f (202e3cfe-2172-49da-859b-97fb0aa9878f): created successfully
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874b4004-b3db-4e0c-a48d-8146414e1085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (79472aee-cfc9-472f-ba24-6c7c7c21b277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8fd5e10-e401-4956-936c-0f7974aaacc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd18ebd0d-66e6-48c5-b961-773ca154ee35', 'volume_name': 'volume-d18ebd0d-66e6-48c5-b961-773ca154ee35', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359967a9f0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db62f36-6c80-4e80-b129-89b4eed937a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4db62f36-6c80-4e80-b129-89b4eed937a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e73a323-113c-4005-a375-781b693f7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:26:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Volume d18ebd0d-66e6-48c5-b961-773ca154ee35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d18ebd0d-66e6-48c5-b961-773ca154ee35', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359967a9f0>}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Trying to clone d18ebd0d-66e6-48c5-b961-773ca154ee35 from image 5accfc22-7cac-4370-846d-07a9c8ee1607 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:26:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a1673e69-250f-4e76-8b39-b58eb223c224 tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:26:59 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf" returned: 0 in 0.880s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:26:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:26:59 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf
Jul 06 13:26:59 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:27:00 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaaeff9-e317-4bfe-baa7-9a893dedbc0c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:00 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD
Jul 06 13:27:00 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:00 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-611cf920-a201-466a-96e8-361d6cae49cf" returned: 0 in 0.736s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-611cf920-a201-466a-96e8-361d6cae49cf" released by "delete_volume" :: held 1.680s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['19a77909-e311-453e-8f92-0cb2e31411f7', '63651ddf-752d-419b-8f8a-a9847266ce93', '1376cfcd-dea3-4bf0-98cc-a03a8c0be70c', 'a4f4c13c-e7b1-4c01-8550-6b1736485efd'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-202e3cfe-2172-49da-859b-97fb0aa9878f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "cinder-202e3cfe-2172-49da-859b-97fb0aa9878f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:00 devstack sudo[96947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:00 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Acquiring lock "cinder-quobyte-202e3cfe-2172-49da-859b-97fb0aa9878f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-202e3cfe-2172-49da-859b-97fb0aa9878f" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec698360-c109-4a02-99da-03bdf998f6aa]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:01 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD" returned: 0 in 0.951s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 is fetched for user 7d17e077f9974a4c88f256747cd7a839. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:27:01 devstack sudo[96952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f
Jul 06 13:27:01 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0ffcde-2373-46fc-a395-b4c9c76d0592]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-539cafab-628f-4a73-bee2-20af945950ca-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-539cafab-628f-4a73-bee2-20af945950ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Deleting offline snapshot 539cafab-628f-4a73-bee2-20af945950ca of volume bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] snapshot_file for this snap is: volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:27:01 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD
Jul 06 13:27:01 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5b531-58de-4bc0-a4b1-c468df301408]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:01 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:27:01 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:01 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.981s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:01 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Deleted volume successfully.
Jul 06 13:27:01 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f" returned: 0 in 0.914s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1359adfb-bd41-4b44-9045-e6db665216c6 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-611cf920-a201-466a-96e8-361d6cae49cf-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:01 devstack sudo[96963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f
Jul 06 13:27:01 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:02 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-192058242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18ebd0d-66e6-48c5-b961-773ca154ee35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0278b54f897447cb37ae9cfefa623c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:26:59Z,use_quota=True,user_id='7d17e077f9974a4c88f256747cd7a839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Creating volume d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:02 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:02 devstack sudo[96971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1073741824
Jul 06 13:27:02 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:02 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 0.918s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab7109e-32c3-49ee-ab43-bb9a05a23784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc585df9-7808-4a86-9caf-f237d225011c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:02 devstack sudo[96973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:27:02 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:02 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-202e3cfe-2172-49da-859b-97fb0aa9878f" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "cinder-quobyte-202e3cfe-2172-49da-859b-97fb0aa9878f" released by "delete_volume" :: held 1.784s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=68,cinder:UPDATE=73,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=9 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Created reservations ['597dcbbf-ce36-4383-b937-de35276a0348', '9c9ac113-efa7-4a05-b2e9-c0493736d3c5', '737f9ef7-2242-4398-bfa6-b652de0e21fe', '986cb5f3-81aa-408d-badd-449902a73f51'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:03 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:03 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:03 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 1.085s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:03 devstack sudo[96986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:27:03 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:03 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1073741824" returned: 0 in 1.333s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:03 devstack sudo[96988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:03 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:03 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.969s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:03 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Deleted volume successfully.
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffc33728-63c9-4cda-99f5-2a1e7628e756 tempest-VolumesActionsTest-268430972 None] Lock "cinder-202e3cfe-2172-49da-859b-97fb0aa9878f-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (8e178f26-d953-4cde-9f59-9e65e0ee20af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bf8408-196e-4069-864f-d15a7be0de9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16bf8408-196e-4069-864f-d15a7be0de9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747545762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9af7674-ab05-410a-808e-60583211017d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:04Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bf14fb-9b20-4224-a4bb-c0c7e58207a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bf14fb-9b20-4224-a4bb-c0c7e58207a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd05c86e-28e9-4e16-97e3-daf8be2deb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd05c86e-28e9-4e16-97e3-daf8be2deb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9af7674-ab05-410a-808e-60583211017d', 'volume_name': 'volume-d9af7674-ab05-410a-808e-60583211017d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f84e50b-1512-4636-be13-cec7d0cdfab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f84e50b-1512-4636-be13-cec7d0cdfab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3766e48d-49c8-440f-abbb-9a72fe467d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:04 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Volume d9af7674-ab05-410a-808e-60583211017d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9af7674-ab05-410a-808e-60583211017d', 'volume_size': 1}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:04 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 1.059s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:04 devstack sudo[96996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca
Jul 06 13:27:04 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:04 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 0.972s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747545762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9af7674-ab05-410a-808e-60583211017d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad23f7203d4a4828b91d2925c0ca61b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:04Z,use_quota=True,user_id='9caed7f665ce430e8e31ba9ba045e9bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Creating volume d9af7674-ab05-410a-808e-60583211017d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:04 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:04 devstack sudo[96998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d 1073741824
Jul 06 13:27:04 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Attempting download of 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume d18ebd0d-66e6-48c5-b961-773ca154ee35. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6e1dc8-380a-4944-a3a8-473c21831d01]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:04 devstack sudo[97000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57
Jul 06 13:27:04 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:05 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784.539cafab-628f-4a73-bee2-20af945950ca" returned: 0 in 0.674s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-539cafab-628f-4a73-bee2-20af945950ca" released by "_delete_snapshot" :: held 3.873s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" released by "delete_snapshot" :: held 3.903s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['4d6f05e3-4af1-4acd-b4af-3c3a5732d161', '53ce8550-397d-4382-bb06-20dd9fd986d5', '84de1299-f2b8-4dfc-aa75-c28480a2df4b', '365dd6ca-8270-489f-8b84-a1303a36eadc'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Delete snapshot completed successfully.
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-11ab6550-871a-483b-a158-f94d7ab48c5d tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-539cafab-628f-4a73-bee2-20af945950ca-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:05 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57" returned: 0 in 0.806s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:05 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d 1073741824" returned: 0 in 0.949s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:05 devstack sudo[97009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57
Jul 06 13:27:05 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:05 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d
Jul 06 13:27:05 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-bab7109e-32c3-49ee-ab43-bb9a05a23784-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-bab7109e-32c3-49ee-ab43-bb9a05a23784-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[57075843-3a4c-4d92-aea9-35990a83ef88]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:05 devstack sudo[97013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:27:05 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:06 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57" returned: 1 in 0.886s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_xor29x57' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d123f68-a7bb-45d5-9d68-e9011f4724d3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:06 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3766e48d-49c8-440f-abbb-9a72fe467d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9af7674-ab05-410a-808e-60583211017d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aacb264-aacc-4061-8893-e011243f727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Volume volume-d9af7674-ab05-410a-808e-60583211017d (d9af7674-ab05-410a-808e-60583211017d): created successfully
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aacb264-aacc-4061-8893-e011243f727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Flow 'volume_create_manager' (8e178f26-d953-4cde-9f59-9e65e0ee20af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e2c8c617-c571-4334-8f69-b9b2eb32ae20 tempest-VolumesActionsTest-765506224 None] Created volume successfully.
Jul 06 13:27:06 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD
Jul 06 13:27:06 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:06 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 0.958s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:06 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784
Jul 06 13:27:06 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:07 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] 5accfc22-7cac-4370-846d-07a9c8ee1607 was qcow2, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:07 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:07 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:07 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bab7109e-32c3-49ee-ab43-bb9a05a23784" returned: 0 in 0.807s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-bab7109e-32c3-49ee-ab43-bb9a05a23784" released by "delete_volume" :: held 1.843s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['2925afa0-f778-48a9-9bdb-6103522a2adf', '7c780549-53cf-4ef9-86f5-a02210a427d1', '2789bc1d-e6fa-4cc3-9e1b-42900c4116f3', 'a76c6e5f-df7e-486b-944c-f1649c2106f3'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:07 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:07 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-d9af7674-ab05-410a-808e-60583211017d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "cinder-d9af7674-ab05-410a-808e-60583211017d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Acquiring lock "cinder-quobyte-d9af7674-ab05-410a-808e-60583211017d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "cinder-quobyte-d9af7674-ab05-410a-808e-60583211017d" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eef7bec-cd79-48fd-b678-4d17941ef380]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:08 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d
Jul 06 13:27:08 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (2de539df-f6c2-4f86-9fe2-55b902c0649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae72bc7-3dc9-4299-abc5-8c9ed48e0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae72bc7-3dc9-4299-abc5-8c9ed48e0493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1242815724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:09Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209b97e2-a820-4e23-b970-2495c9efe358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209b97e2-a820-4e23-b970-2495c9efe358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e84e6c0-5859-42cc-9f47-ab6f65cc5674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e84e6c0-5859-42cc-9f47-ab6f65cc5674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d', 'volume_name': 'volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeac2fd-f719-46eb-95bf-7b4fd5e3e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeac2fd-f719-46eb-95bf-7b4fd5e3e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b98cb7-de72-4fab-ac7a-e04eac5cee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:08 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Volume 36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d', 'volume_size': 1}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1242815724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:09Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Creating volume 36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:08 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:08 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.094s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Deleted volume successfully.
Jul 06 13:27:08 devstack sudo[97080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d 1073741824
Jul 06 13:27:08 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e085f21-b375-45b2-9573-6d842469bbc8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-bab7109e-32c3-49ee-ab43-bb9a05a23784-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:09 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d" returned: 0 in 1.143s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:09 devstack sudo[97086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d
Jul 06 13:27:09 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:09 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 2.743s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_gpzm19hadevstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:27:09 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Converted 112.00 MB image at 40.81 MB/s
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:09 devstack sudo[97091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1G
Jul 06 13:27:09 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (92d7ce90-1365-42f3-808b-61413e31963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c779b7-6f71-48ef-87b5-eea564d7441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c779b7-6f71-48ef-87b5-eea564d7441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1797857740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a1848-1c37-49db-b18d-d454385f4a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:10Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfbc006-7bc3-4407-9af0-167e517f3f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfbc006-7bc3-4407-9af0-167e517f3f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f1517d-d85d-4d0e-85be-f06111d6631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f1517d-d85d-4d0e-85be-f06111d6631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66a1848-1c37-49db-b18d-d454385f4a3c', 'volume_name': 'volume-d66a1848-1c37-49db-b18d-d454385f4a3c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f043d725-91cf-43cf-8d98-1db9ca1017a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f043d725-91cf-43cf-8d98-1db9ca1017a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d67eab-86bb-433e-9977-cbc863d1c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:10 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Volume d66a1848-1c37-49db-b18d-d454385f4a3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66a1848-1c37-49db-b18d-d454385f4a3c', 'volume_size': 1}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:10 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d 1073741824" returned: 0 in 1.244s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:10 devstack sudo[97094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:10 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:10 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d9af7674-ab05-410a-808e-60583211017d" returned: 0 in 1.044s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "cinder-quobyte-d9af7674-ab05-410a-808e-60583211017d" released by "delete_volume" :: held 2.250s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Created reservations ['70aa1a00-12fe-4ddb-bb45-300cc4948c0b', '43dd5082-3d4d-4923-b651-a65480ccddbc', '5180e4fc-ccb4-4e55-b297-70caa7d05533', '642ac319-f1c3-4abd-9f4b-ae0e537742df'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:10 devstack sudo[97097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:10 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:10 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 1G" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bafd5a-5014-410d-a626-9448f26c4064]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:10 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 0.815s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1797857740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66a1848-1c37-49db-b18d-d454385f4a3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:10Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Creating volume d66a1848-1c37-49db-b18d-d454385f4a3c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:10 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:10 devstack sudo[97103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:10 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:11 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c 1073741824
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b98cb7-de72-4fab-ac7a-e04eac5cee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:11 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d6a26-5821-4fad-bfee-a705fdb717e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Volume volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d (36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d): created successfully
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9d6a26-5821-4fad-bfee-a705fdb717e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (2de539df-f6c2-4f86-9fe2-55b902c0649e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0b440b04-8e13-4dcb-955b-84fb1cfeb8a8 tempest-VolumesSnapshotTestJSON-921271547 None] Created volume successfully.
Jul 06 13:27:11 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.855s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Deleted volume successfully.
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43b9fe59-a13e-4421-b813-b5abe4b84522 tempest-VolumesActionsTest-765506224 None] Lock "cinder-d9af7674-ab05-410a-808e-60583211017d-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:11 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 0.920s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:11 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:11 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:12 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c 1073741824" returned: 0 in 1.198s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:12 devstack sudo[97115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c
Jul 06 13:27:12 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:12 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 1 in 1.041s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Downloaded image 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume d18ebd0d-66e6-48c5-b961-773ca154ee35 successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 for user 7d17e077f9974a4c88f256747cd7a839 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Marking volume d18ebd0d-66e6-48c5-b961-773ca154ee35 as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Copying metadata from image 5accfc22-7cac-4370-846d-07a9c8ee1607 to d18ebd0d-66e6-48c5-b961-773ca154ee35. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Creating volume glance metadata for volume d18ebd0d-66e6-48c5-b961-773ca154ee35 backed by image 5accfc22-7cac-4370-846d-07a9c8ee1607 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e73a323-113c-4005-a375-781b693f7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18ebd0d-66e6-48c5-b961-773ca154ee35', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359967a9f0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cef665-5711-49e9-968e-d10f5da97842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:13 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:13 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Volume volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 (d18ebd0d-66e6-48c5-b961-773ca154ee35): created successfully
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cef665-5711-49e9-968e-d10f5da97842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Flow 'volume_create_manager' (a8aeb634-d36b-4d5c-96f7-dd70613d6370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c" returned: 0 in 0.804s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8461c767-97d3-4433-8b49-ea75a136f34f tempest-TestShelveInstance-276568591 None] Created volume successfully.
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d67eab-86bb-433e-9977-cbc863d1c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66a1848-1c37-49db-b18d-d454385f4a3c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5df2730-4b40-46ee-b7c7-f69615ffcb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Creating offline snapshot 8db6327b-784a-4d19-8a71-a8af6948887d of volume 36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:27:13 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Volume volume-d66a1848-1c37-49db-b18d-d454385f4a3c (d66a1848-1c37-49db-b18d-d454385f4a3c): created successfully
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5df2730-4b40-46ee-b7c7-f69615ffcb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (92d7ce90-1365-42f3-808b-61413e31963f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8b1cd4-f681-4293-8f24-5db3c2bf0a63]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-eaf6d8e7-15a8-4e6b-9adc-63b7649f3459 tempest-AttachVolumeNegativeTest-134439578 None] Created volume successfully.
Jul 06 13:27:13 devstack sudo[97122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:13 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:13 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:14 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d 1G
Jul 06 13:27:14 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:15 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d 1G" returned: 0 in 1.010s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:15 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:15 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:15 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 0.961s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:15 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d is being set with open permissions: ugo+rw
Jul 06 13:27:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:16 devstack sudo[97147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:16 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 0.804s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:16 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:16 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info
Jul 06 13:27:16 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:17 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info" returned: 0 in 0.758s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:17 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info is being set with open permissions: ugo+rw
Jul 06 13:27:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:17 devstack sudo[97169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info
Jul 06 13:27:17 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:18 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.info" returned: 0 in 0.776s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.336s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.940s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fce09-16b7-4c52-813d-748f424f56e7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f89e358e-6dbe-4836-9866-70c7549a991c tempest-VolumesSnapshotTestJSON-921271547 None] Create snapshot completed successfully
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:18 devstack sudo[97173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:18 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:18 devstack sudo[97172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c
Jul 06 13:27:18 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:19 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.025s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:27:19 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c" returned: 0 in 1.097s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.123s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-d66a1848-1c37-49db-b18d-d454385f4a3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90cbe797-6ca3-4e51-a666-0edf8f0b12a8', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (7304b337-b516-4c97-a357-821fde4c661b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64837c9-b947-41c4-89a6-5f76fe0918b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64837c9-b947-41c4-89a6-5f76fe0918b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1698318870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943fbb1b-f27b-45f1-a23c-7028063e807e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdaef79137495da6ab717bad7ff9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8db6327b-784a-4d19-8a71-a8af6948887d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:19Z,use_quota=True,user_id='8779c172875042dfba7e20f66ff156aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd83a4e-dbf1-4192-acfa-daf2cfec7342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd83a4e-dbf1-4192-acfa-daf2cfec7342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df836b5b-cf7e-4050-b6fb-1adb7cf207f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df836b5b-cf7e-4050-b6fb-1adb7cf207f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '943fbb1b-f27b-45f1-a23c-7028063e807e', 'volume_name': 'volume-943fbb1b-f27b-45f1-a23c-7028063e807e', 'volume_size': 1, 'snapshot_id': '8db6327b-784a-4d19-8a71-a8af6948887d'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5555b3e-3bc1-43b0-bb5c-28198f4bb30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5555b3e-3bc1-43b0-bb5c-28198f4bb30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f2152d-951a-479a-8022-e7f46ae7da60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:19 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Volume 943fbb1b-f27b-45f1-a23c-7028063e807e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-943fbb1b-f27b-45f1-a23c-7028063e807e', 'volume_size': 1, 'snapshot_id': '8db6327b-784a-4d19-8a71-a8af6948887d'}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d-943fbb1b-f27b-45f1-a23c-7028063e807e" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d-943fbb1b-f27b-45f1-a23c-7028063e807e" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Creating volume 943fbb1b-f27b-45f1-a23c-7028063e807e from snapshot 8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] snapshot: 8db6327b-784a-4d19-8a71-a8af6948887d, volume: 943fbb1b-f27b-45f1-a23c-7028063e807e,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:27:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-f3d9c5f8-4a27-4a2d-8661-12d3078049d1 req-8b11f651-45ea-47cb-a5b8-9ced0da78332 tempest-AttachVolumeNegativeTest-134439578 None] attachment_update completed successfully.
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aec20c5-a80e-4345-afde-e4bd7d48f1cb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:19 devstack sudo[97181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:19 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:21 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 1.446s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8510742-18d8-4996-be50-a77f6a8a9054]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:21 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:21 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:22 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 1.160s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:22 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:27:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:22 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e
Jul 06 13:27:22 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:29 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e" returned: 0 in 6.652s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f585dc5-4dd2-44ba-9036-6a29cc0e41b5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:29 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:29 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:29 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=37,cinder:UPDATE=47,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:27:30 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 1.126s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:30 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:27:30 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Converted 1024.00 MB image at 153.91 MB/s
Jul 06 13:27:30 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e is being set with open permissions: ugo+rw
Jul 06 13:27:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:30 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e
Jul 06 13:27:30 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:30 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e" returned: 0 in 0.741s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" released by "_copy_volume_from_snapshot" :: held 11.282s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d-943fbb1b-f27b-45f1-a23c-7028063e807e" released by "_create_volume_from_snapshot" :: held 11.321s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.343s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.287s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f2152d-951a-479a-8022-e7f46ae7da60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943fbb1b-f27b-45f1-a23c-7028063e807e', 'volume_size': 1, 'snapshot_id': '8db6327b-784a-4d19-8a71-a8af6948887d'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821984e-8e87-4092-b49e-bf6cbd26ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa65eb6-9378-47f5-8811-d16cd0089714]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:31 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Volume volume-943fbb1b-f27b-45f1-a23c-7028063e807e (943fbb1b-f27b-45f1-a23c-7028063e807e): created successfully
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b821984e-8e87-4092-b49e-bf6cbd26ec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Flow 'volume_create_manager' (7304b337-b516-4c97-a357-821fde4c661b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3720d06a-0f74-49d4-887b-7f6207f080fb tempest-VolumesSnapshotTestJSON-921271547 None] Created volume successfully.
Jul 06 13:27:31 devstack sudo[97612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:31 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:32 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 1.016s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:32 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:27:32 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-943fbb1b-f27b-45f1-a23c-7028063e807e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-943fbb1b-f27b-45f1-a23c-7028063e807e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e95ac1-24e9-40fe-89c5-7c49f8ac9d84]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:32 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e
Jul 06 13:27:32 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:33 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 1 in 0.996s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.108s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-d18ebd0d-66e6-48c5-b961-773ca154ee35', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a903b57f-5c0d-41db-8dcd-a2f4f6e42704', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:27:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-0f1150e8-3693-45ba-8f9d-01c10097f669 req-85fbbbd7-ab6b-4d77-8115-a56f4f2f22da tempest-TestShelveInstance-276568591 None] attachment_update completed successfully.
Jul 06 13:27:33 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e" returned: 0 in 0.888s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:33 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e
Jul 06 13:27:33 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:34 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-943fbb1b-f27b-45f1-a23c-7028063e807e" returned: 0 in 0.702s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-943fbb1b-f27b-45f1-a23c-7028063e807e" released by "delete_volume" :: held 1.655s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['9ca9e8b0-8d1b-41b1-bc97-fb6984bc5c65', '703f5290-b634-47fd-8478-d770d23c5f6a', '6587fa5a-71c3-4758-b7cc-23117a09df7d', '5973a2bd-85bf-41c8-827c-3a44b97c8383'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:34 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:34 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Flow 'volume_create_manager' (da22370b-9bfe-4d76-b15f-113a86ac9c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3481e489-a4f1-4e51-9adb-d0f951411ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3481e489-a4f1-4e51-9adb-d0f951411ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-235294517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1579a94b-7b0b-4e40-8c33-0ad345a6943d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1383172b37483e81e19e9e92d96dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:35Z,use_quota=True,user_id='81f5bac535b345eda0bcc0dab6a9549f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc16aa8f-ed88-4c99-960a-a73f8d216517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc16aa8f-ed88-4c99-960a-a73f8d216517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04953c56-4c42-4472-b30f-58dec9053e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04953c56-4c42-4472-b30f-58dec9053e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1579a94b-7b0b-4e40-8c33-0ad345a6943d', 'volume_name': 'volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1107cd-f2e9-4054-b44a-9ac17c507894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1107cd-f2e9-4054-b44a-9ac17c507894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2699ca6c-31c9-418f-b721-936336d2d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Volume 1579a94b-7b0b-4e40-8c33-0ad345a6943d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d', 'volume_size': 1}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-235294517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1579a94b-7b0b-4e40-8c33-0ad345a6943d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1383172b37483e81e19e9e92d96dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:35Z,use_quota=True,user_id='81f5bac535b345eda0bcc0dab6a9549f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Creating volume 1579a94b-7b0b-4e40-8c33-0ad345a6943d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:34 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:34 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d 1073741824
Jul 06 13:27:34 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-8db6327b-784a-4d19-8a71-a8af6948887d-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-8db6327b-784a-4d19-8a71-a8af6948887d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Deleting offline snapshot 8db6327b-784a-4d19-8a71-a8af6948887d of volume 36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] snapshot_file for this snap is: volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2c6ce-0ea3-4430-abd3-5659d28600a6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:35 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:35 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:35 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.940s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Deleted volume successfully.
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7d260225-30f6-4311-8bd2-3e398f25af9a tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-943fbb1b-f27b-45f1-a23c-7028063e807e-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:35 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d 1073741824" returned: 0 in 1.226s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:35 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d
Jul 06 13:27:35 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:35 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 1.082s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:27:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f320f5-aadb-4cbc-82d4-3c651e393c93]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:36 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:36 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:37 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d" returned: 0 in 1.081s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2699ca6c-31c9-418f-b721-936336d2d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c5ac97-4328-4745-bf4b-a7be8d894f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:37 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Volume volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d (1579a94b-7b0b-4e40-8c33-0ad345a6943d): created successfully
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c5ac97-4328-4745-bf4b-a7be8d894f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Flow 'volume_create_manager' (da22370b-9bfe-4d76-b15f-113a86ac9c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-179dabac-ddd0-46ec-a860-2d30448ec84f tempest-VolumesTransfersTest-1893843711 None] Created volume successfully.
Jul 06 13:27:37 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 1.307s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:37 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:37 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:38 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 1.109s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:38 devstack sudo[97727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d
Jul 06 13:27:38 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f7f35234-cc5c-4802-a42f-cc76d6d0f244 tempest-VolumesTransfersTest-1998189328 None] Transfer volume completed successfully.
Jul 06 13:27:39 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d.8db6327b-784a-4d19-8a71-a8af6948887d" returned: 0 in 0.981s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-8db6327b-784a-4d19-8a71-a8af6948887d" released by "_delete_snapshot" :: held 4.606s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" released by "delete_snapshot" :: held 4.633s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:39 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['f9b72365-e744-4ccb-bce1-2764c46e1056', '234b5d78-4507-45f3-a89e-fb5385fd6a37', '3e421562-b151-4cf1-bad7-701490096b78', 'ae97012e-5421-4e76-a5f1-a8e43977c552'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Delete snapshot completed successfully.
Jul 06 13:27:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-97c666aa-0c35-45bd-9d1a-16451c19e04c tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-8db6327b-784a-4d19-8a71-a8af6948887d-delete_snapshot" released by "delete_snapshot" :: held 4.840s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "cinder-1579a94b-7b0b-4e40-8c33-0ad345a6943d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-1579a94b-7b0b-4e40-8c33-0ad345a6943d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "cinder-quobyte-1579a94b-7b0b-4e40-8c33-0ad345a6943d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-quobyte-1579a94b-7b0b-4e40-8c33-0ad345a6943d" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f581be-7b09-438f-aa1a-12a686c8ebcc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" acquired by "delete_volume" :: waited 0.045s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:40 devstack sudo[97773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d
Jul 06 13:27:40 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36a0a4-a113-4707-832c-e8e35e135920]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:40 devstack sudo[97775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:40 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:41 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d" returned: 0 in 1.289s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:41 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d
Jul 06 13:27:41 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:41 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 1.332s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:41 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d
Jul 06 13:27:41 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:43 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1579a94b-7b0b-4e40-8c33-0ad345a6943d" returned: 0 in 1.635s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-quobyte-1579a94b-7b0b-4e40-8c33-0ad345a6943d" released by "delete_volume" :: held 3.037s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Created reservations ['a07e5c46-15a2-4c92-88ea-2306bec24962', 'b7e4c2d2-17c0-4b37-9602-c9a1de04493d', 'fed3cc36-e1f6-4066-9403-2801aa52db4a', '1758f2b5-b5e5-4fc4-954b-2e3adcf7fd57'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:43 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" returned: 0 in 1.644s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:43 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:43 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d" released by "delete_volume" :: held 3.100s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['f0412e6f-e3a5-4e2a-b653-949e8b34fff5', 'f10fab15-e194-4184-8640-ba74e90f19d7', 'fbe25817-680f-4b83-940a-2c31114d6a09', 'be02ac8e-1bc2-4364-a685-8d7fda1bf22b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:44 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:44 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-3c477778-2a58-4441-a9af-a025a48ec935-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-3c477778-2a58-4441-a9af-a025a48ec935-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519140a-7b8f-433c-88da-63f4a956b00e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:44 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935
Jul 06 13:27:44 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:45 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Flow 'volume_create_manager' (3b224c6a-30dc-447d-a7fc-1c84a9c9fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6da849-bf9c-4f51-abfb-9e2dfcb6162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.299s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Deleted volume successfully.
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6da849-bf9c-4f51-abfb-9e2dfcb6162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1380336069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2cdf27-65f0-49d1-9249-e99e808d5bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1383172b37483e81e19e9e92d96dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:45Z,use_quota=True,user_id='81f5bac535b345eda0bcc0dab6a9549f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1828e3ce-4789-478f-b5ba-3010d79491a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1828e3ce-4789-478f-b5ba-3010d79491a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266c367a-c633-4220-a7e5-a52316257084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266c367a-c633-4220-a7e5-a52316257084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2cdf27-65f0-49d1-9249-e99e808d5bd0', 'volume_name': 'volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52fc794-e5d7-4894-9a2c-8090cf71125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52fc794-e5d7-4894-9a2c-8090cf71125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffa4d6f-1f9d-493e-b9bb-1cada3fc494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:45 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Volume fb2cdf27-65f0-49d1-9249-e99e808d5bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0', 'volume_size': 1}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1380336069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2cdf27-65f0-49d1-9249-e99e808d5bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1383172b37483e81e19e9e92d96dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:27:45Z,use_quota=True,user_id='81f5bac535b345eda0bcc0dab6a9549f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Creating volume fb2cdf27-65f0-49d1-9249-e99e808d5bd0 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:27:45 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:27:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ef95bf5-3024-47a4-a1f7-fcf689d2ad37 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-1579a94b-7b0b-4e40-8c33-0ad345a6943d-delete_volume" released by "delete_volume" :: held 5.929s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:46 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 1073741824
Jul 06 13:27:46 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:46 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.078s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Deleted volume successfully.
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d34823a0-32a1-41bc-8b98-b7588974b303 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-36c1c2a3-a7f2-4c59-b207-dd0e4c485a6d-delete_volume" released by "delete_volume" :: held 5.744s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:46 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935" returned: 0 in 2.078s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:46 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935
Jul 06 13:27:46 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:47 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 1073741824" returned: 0 in 1.812s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:47 devstack sudo[97854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0
Jul 06 13:27:47 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:48 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3c477778-2a58-4441-a9af-a025a48ec935" returned: 0 in 1.575s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-quobyte-3c477778-2a58-4441-a9af-a025a48ec935" released by "delete_volume" :: held 3.836s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Created reservations ['fd9ec172-c4dc-4b0b-9714-461e66d6a806', '78b926df-1d6c-4bab-85f0-f1d7ecf4bb5a', '8f236bf3-cf8f-4e48-8b15-c7db40d4cffe', '4a7132bf-8212-466a-8877-88656de38a04'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:48 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:48 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:49 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.054s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Deleted volume successfully.
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bbe4991b-96c3-4ec2-be34-e85502d5e5c8 tempest-VolumesSnapshotTestJSON-921271547 None] Lock "cinder-3c477778-2a58-4441-a9af-a025a48ec935-delete_volume" released by "delete_volume" :: held 5.430s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:49 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" returned: 0 in 2.120s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] <== create_volume: return (4017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:27:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.021s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffa4d6f-1f9d-493e-b9bb-1cada3fc494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3b283a-63ee-482c-a131-bbfa1de6b191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:27:50 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Volume volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 (fb2cdf27-65f0-49d1-9249-e99e808d5bd0): created successfully
Jul 06 13:27:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3b283a-63ee-482c-a131-bbfa1de6b191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:27:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Flow 'volume_create_manager' (3b224c6a-30dc-447d-a7fc-1c84a9c9fde4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:27:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9ad3705e-5cf4-4bd9-b9d2-1ee6fb61cfcb tempest-VolumesTransfersTest-1893843711 None] Created volume successfully.
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "cinder-fb2cdf27-65f0-49d1-9249-e99e808d5bd0-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-fb2cdf27-65f0-49d1-9249-e99e808d5bd0-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "cinder-quobyte-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-quobyte-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7620e3-5fa4-472b-86ac-8c60fa46c02f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:27:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:52 devstack sudo[97866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0
Jul 06 13:27:52 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:53 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" returned: 0 in 1.580s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:53 devstack sudo[97873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0
Jul 06 13:27:53 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:54 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" returned: 0 in 1.036s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-quobyte-fb2cdf27-65f0-49d1-9249-e99e808d5bd0" released by "delete_volume" :: held 2.676s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:27:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Created reservations ['a52384f6-b82a-4b02-b9d1-80353a726075', '693de133-068e-4eeb-aee1-88f258519211', 'a55b2361-4c76-4b5e-bcc1-60cfdc74f5e7', 'f83f486e-ab01-4b0d-8f46-5b61a536fd68'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:27:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:27:55 devstack sudo[97876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:27:55 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:27:56 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root
Jul 06 13:27:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.350s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:27:56 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:27:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Deleted volume successfully.
Jul 06 13:27:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a8a6b26-b6b6-4b62-a11a-44d95d216610 tempest-VolumesTransfersTest-1187570359 None] Lock "cinder-fb2cdf27-65f0-49d1-9249-e99e808d5bd0-delete_volume" released by "delete_volume" :: held 4.648s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:INSERT=31,cinder:UPDATE=101,cinder:SELECT=92,cinder:DELETE=9 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Flow 'volume_create_manager' (a5f54f40-3d70-4229-8041-c91de9ace8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c9905-2172-4fdd-a05e-2356dd7661dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c9905-2172-4fdd-a05e-2356dd7661dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-275486720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dda360-ffa3-4acd-945c-573f2fad41f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51589937236340fe95599970be22d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:04Z,use_quota=True,user_id='d875745405ba499d80391965a3830ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3cac83-f8ee-442c-b9e1-2cc929ecb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3cac83-f8ee-442c-b9e1-2cc929ecb93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584b6730-004b-4d1f-80cd-939416f2acf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584b6730-004b-4d1f-80cd-939416f2acf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10dda360-ffa3-4acd-945c-573f2fad41f2', 'volume_name': 'volume-10dda360-ffa3-4acd-945c-573f2fad41f2', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359953e840>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a749b9-bfcc-449f-a862-ad363e98abdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a749b9-bfcc-449f-a862-ad363e98abdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3101d0-52be-43b8-862b-fb2231495f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:04 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Volume 10dda360-ffa3-4acd-945c-573f2fad41f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10dda360-ffa3-4acd-945c-573f2fad41f2', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359953e840>}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Trying to clone 10dda360-ffa3-4acd-945c-573f2fad41f2 from image 5accfc22-7cac-4370-846d-07a9c8ee1607 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:28:04 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:28:04 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbaed47-6223-4bfe-92fa-268c362ab57f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:05 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD
Jul 06 13:28:05 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:05 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD" returned: 0 in 0.871s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 is fetched for user d875745405ba499d80391965a3830ade. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d20c7e-9c37-42f7-9fc5-1aad0d59baa8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:06 devstack sudo[98019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD
Jul 06 13:28:06 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:06 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD" returned: 0 in 1.007s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-275486720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dda360-ffa3-4acd-945c-573f2fad41f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51589937236340fe95599970be22d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:04Z,use_quota=True,user_id='d875745405ba499d80391965a3830ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Creating volume 10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:28:07 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:28:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:07 devstack sudo[98061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1073741824
Jul 06 13:28:07 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:08 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1073741824" returned: 0 in 1.182s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:08 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:08 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:09 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 1.283s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Attempting download of 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 10dda360-ffa3-4acd-945c-573f2fad41f2. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb5c3ba-0ed5-4a5f-bc32-bc79c36c1907]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:09 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih
Jul 06 13:28:09 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:10 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih" returned: 0 in 1.003s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:10 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih
Jul 06 13:28:10 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:11 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih" returned: 1 in 0.965s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_56dmskih' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[269e2985-8e30-4e14-9baa-e66ba54b02c2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:11 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD
Jul 06 13:28:11 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:12 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD" returned: 0 in 0.953s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:12 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] 5accfc22-7cac-4370-846d-07a9c8ee1607 was qcow2, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:28:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:12 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:12 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:15 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 2.762s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:15 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_cxaop2qndevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:28:15 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Converted 112.00 MB image at 40.52 MB/s
Jul 06 13:28:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:15 devstack sudo[98132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1G
Jul 06 13:28:15 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:16 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 1G" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aad26b-4dfe-4049-bd84-5cdebba057de]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:16 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:16 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:17 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 0.822s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:17 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:17 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:18 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 1 in 0.936s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Downloaded image 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 10dda360-ffa3-4acd-945c-573f2fad41f2 successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 for user d875745405ba499d80391965a3830ade is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Marking volume 10dda360-ffa3-4acd-945c-573f2fad41f2 as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Copying metadata from image 5accfc22-7cac-4370-846d-07a9c8ee1607 to 10dda360-ffa3-4acd-945c-573f2fad41f2. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Creating volume glance metadata for volume 10dda360-ffa3-4acd-945c-573f2fad41f2 backed by image 5accfc22-7cac-4370-846d-07a9c8ee1607 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3101d0-52be-43b8-862b-fb2231495f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10dda360-ffa3-4acd-945c-573f2fad41f2', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359953e840>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1ede81-9b4b-4f8d-aaf7-caece329d448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Volume volume-10dda360-ffa3-4acd-945c-573f2fad41f2 (10dda360-ffa3-4acd-945c-573f2fad41f2): created successfully
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1ede81-9b4b-4f8d-aaf7-caece329d448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Flow 'volume_create_manager' (a5f54f40-3d70-4229-8041-c91de9ace8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bc6275e1-1f05-4066-b001-434aa6caecdd tempest-VolumesExtendTest-692535333 None] Created volume successfully.
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:18 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:28:18 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa3f4d-317e-462b-af44-db807f040b2a]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:19 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:19 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:19 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.309s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:28:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-4e6ea2aa-f0cf-49c2-89eb-864b58df5737 req-1aa3bd8b-b284-4074-b55b-d7bc0f2990f8 tempest-TestShelveInstance-276568591 None] Terminate volume connection completed successfully.
Jul 06 13:28:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-4e6ea2aa-f0cf-49c2-89eb-864b58df5737 req-1aa3bd8b-b284-4074-b55b-d7bc0f2990f8 tempest-TestShelveInstance-276568591 None] Deleting attachment a903b57f-5c0d-41db-8dcd-a2f4f6e42704. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:28:20 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 1.069s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:20 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:20 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:21 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 1 in 1.122s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 2G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 2G" returned: 0 in 0.106s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.381s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ead8ff05-227f-41fe-b565-06df4b91cd5d tempest-VolumesExtendTest-692535333 None] Extend volume completed successfully.
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-10dda360-ffa3-4acd-945c-573f2fad41f2-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "cinder-10dda360-ffa3-4acd-945c-573f2fad41f2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-quobyte-10dda360-ffa3-4acd-945c-573f2fad41f2" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-10dda360-ffa3-4acd-945c-573f2fad41f2" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4078c88-ea18-4d47-a5b8-d36b23efa3b3]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-5f4abb6a-6fcc-4f1b-9763-f05ea5ebba56 req-3013e679-2494-48a3-8c8e-d5ab67f643b4 tempest-AttachVolumeNegativeTest-134439578 None] Terminate volume connection completed successfully.
Jul 06 13:28:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-5f4abb6a-6fcc-4f1b-9763-f05ea5ebba56 req-3013e679-2494-48a3-8c8e-d5ab67f643b4 tempest-AttachVolumeNegativeTest-134439578 None] Deleting attachment 90cbe797-6ca3-4e51-a666-0edf8f0b12a8. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:28:23 devstack sudo[98194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:23 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:24 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 1.151s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:24 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:24 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:25 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 1 in 0.985s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:25 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2
Jul 06 13:28:25 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:25 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-10dda360-ffa3-4acd-945c-573f2fad41f2" returned: 0 in 0.902s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-10dda360-ffa3-4acd-945c-573f2fad41f2" released by "delete_volume" :: held 3.167s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Created reservations ['9d547944-efe2-4caf-92dd-7083fdedd643', 'afa83709-572f-4d9b-9339-54d51a6b9b08', '8261d528-3a4f-4180-92a1-2afbb4e2c5bf', 'b243c002-77cb-4f25-8351-6dc765a768ad'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:26 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:28:26 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Flow 'volume_create_manager' (e35652ea-7494-436c-b409-dd0531f15bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7062ff4-86d5-4669-8f39-ef3110ac6071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7062ff4-86d5-4669-8f39-ef3110ac6071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1734106285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f252918c-2ced-4555-9a93-b56a5c2e1739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51589937236340fe95599970be22d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:27Z,use_quota=True,user_id='d875745405ba499d80391965a3830ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b6971-ba95-47bb-bb6a-e27a850fcd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7b6971-ba95-47bb-bb6a-e27a850fcd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5e9777-4167-4d46-a412-010277750351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5e9777-4167-4d46-a412-010277750351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f252918c-2ced-4555-9a93-b56a5c2e1739', 'volume_name': 'volume-f252918c-2ced-4555-9a93-b56a5c2e1739', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdf9e08-d102-4be2-a83f-76cac60a88cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdf9e08-d102-4be2-a83f-76cac60a88cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa23406-d4e2-4237-8d18-b3803d1214ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Volume f252918c-2ced-4555-9a93-b56a5c2e1739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f252918c-2ced-4555-9a93-b56a5c2e1739', 'volume_size': 1}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1734106285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f252918c-2ced-4555-9a93-b56a5c2e1739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51589937236340fe95599970be22d132',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:27Z,use_quota=True,user_id='d875745405ba499d80391965a3830ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Creating volume f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:28:26 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:26 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.764s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:28:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Deleted volume successfully.
Jul 06 13:28:26 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 1073741824
Jul 06 13:28:26 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b0935c98-c336-4c64-b914-dc8dad11406b tempest-VolumesExtendTest-692535333 None] Lock "cinder-10dda360-ffa3-4acd-945c-573f2fad41f2-delete_volume" released by "delete_volume" :: held 4.232s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:27 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 1073741824" returned: 0 in 1.106s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:28 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:28 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:28 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 0.832s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] <== create_volume: return (1987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.447s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa23406-d4e2-4237-8d18-b3803d1214ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f252918c-2ced-4555-9a93-b56a5c2e1739', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e619a6ce-095a-4ab5-9f84-4b87f98d1944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Volume volume-f252918c-2ced-4555-9a93-b56a5c2e1739 (f252918c-2ced-4555-9a93-b56a5c2e1739): created successfully
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e619a6ce-095a-4ab5-9f84-4b87f98d1944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Flow 'volume_create_manager' (e35652ea-7494-436c-b409-dd0531f15bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9b2be5bc-1782-4f8b-a18f-b46d1cf27adf tempest-VolumesExtendTest-692535333 None] Created volume successfully.
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4889ae8a-76b1-4c4c-ad03-080dc0b09a8c]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:29 devstack sudo[98251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:28:29 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:29 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 0.846s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:29 devstack sudo[98255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:28:29 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=62,cinder:UPDATE=75,cinder:DELETE=5,cinder:INSERT=22 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (1342f5a8-7b28-4435-9412-09d3b3e7c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101dfbc2-7ba7-4961-9a1d-b3ccf66bad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (101dfbc2-7ba7-4961-9a1d-b3ccf66bad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-918297753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e46478e-b753-422d-a9f6-4727eb01056f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:30Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7419f5fd-d4da-4717-b23e-9cf38ecc859b),volume_type_id=7419f5fd-d4da-4717-b23e-9cf38ecc859b)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2a46f9-eb81-4c2f-8694-9064aa0b9788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2a46f9-eb81-4c2f-8694-9064aa0b9788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0177aec-f39a-45c7-bed3-7bf523ff648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0177aec-f39a-45c7-bed3-7bf523ff648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e46478e-b753-422d-a9f6-4727eb01056f', 'volume_name': 'volume-0e46478e-b753-422d-a9f6-4727eb01056f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae2407f-2b56-4861-b9b0-c2ab08af670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae2407f-2b56-4861-b9b0-c2ab08af670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce2bf5-c77f-4a8b-a299-a22d391cd3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume 0e46478e-b753-422d-a9f6-4727eb01056f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e46478e-b753-422d-a9f6-4727eb01056f', 'volume_size': 1}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:30 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 1 in 0.912s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.857s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-918297753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e46478e-b753-422d-a9f6-4727eb01056f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:30Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7419f5fd-d4da-4717-b23e-9cf38ecc859b),volume_type_id=7419f5fd-d4da-4717-b23e-9cf38ecc859b)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Creating volume 0e46478e-b753-422d-a9f6-4727eb01056f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:28:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:30 devstack sudo[98262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f 1073741824
Jul 06 13:28:30 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-d18ebd0d-66e6-48c5-b961-773ca154ee35', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e9558f3-7907-44aa-b6fd-9523975dfd2d', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (4e3192e2-3536-4c5d-9407-96ed0ea44964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e57c-e91e-429e-9787-2eb489454d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-236f0033-05b5-4bce-8b7f-d369aa418634 req-0902cdb6-52ca-4e52-907a-7f284c899dc6 tempest-TestShelveInstance-276568591 None] attachment_update completed successfully.
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a7e57c-e91e-429e-9787-2eb489454d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-871763122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b902b2e-67bb-4be2-b306-0a293c8efbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:31Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f344141-3bc7-48b5-a8f1-e0de19b94b50),volume_type_id=5f344141-3bc7-48b5-a8f1-e0de19b94b50)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02820b49-a79a-4ddc-a78a-8e836b593771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02820b49-a79a-4ddc-a78a-8e836b593771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed16ca7-eb25-4e0b-84ce-fa28f42ba46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed16ca7-eb25-4e0b-84ce-fa28f42ba46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b902b2e-67bb-4be2-b306-0a293c8efbc9', 'volume_name': 'volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ba9bf-4c99-42ce-ba07-8eb81d8bddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560ba9bf-4c99-42ce-ba07-8eb81d8bddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8734d9f-2496-4e09-87b2-7fd319275902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume 3b902b2e-67bb-4be2-b306-0a293c8efbc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9', 'volume_size': 1}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (90191dee-012f-4bd6-8b37-562015d8c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb052d9-41bd-4c95-908e-fd507c988fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb052d9-41bd-4c95-908e-fd507c988fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1439576954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5de10b-40c3-4f1a-b95c-8e167fb8cb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:32Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42537a8-3b28-4e32-8964-9fc93ce24897),volume_type_id=a42537a8-3b28-4e32-8964-9fc93ce24897)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99315b-bee3-41c5-9461-b1af38c5b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99315b-bee3-41c5-9461-b1af38c5b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861e8835-998c-4561-9c53-13c1b7f2ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:28:31 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f 1073741824" returned: 0 in 1.117s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:31 devstack sudo[98269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f
Jul 06 13:28:31 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (861e8835-998c-4561-9c53-13c1b7f2ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e5de10b-40c3-4f1a-b95c-8e167fb8cb55', 'volume_name': 'volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55', 'volume_size': 1, 'image_id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652402050', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1ad53e7dcbb4cd0a364fa9f6867f6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'created_at': datetime.datetime(2026, 7, 6, 11, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b09ed05-0004-4a30-9dba-14e071ba5bec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599578890>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e43e3be-cc80-4cfe-9c74-2337b93b18a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e43e3be-cc80-4cfe-9c74-2337b93b18a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49264e5a-f890-48e2-8292-fc3560a3c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55', 'volume_size': 1, 'image_id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652402050', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1ad53e7dcbb4cd0a364fa9f6867f6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'created_at': datetime.datetime(2026, 7, 6, 11, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b09ed05-0004-4a30-9dba-14e071ba5bec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599578890>}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Trying to clone 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 from image 8b09ed05-0004-4a30-9dba-14e071ba5bec at location (None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:28:32 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f" returned: 0 in 0.788s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-871763122',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b902b2e-67bb-4be2-b306-0a293c8efbc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:31Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f344141-3bc7-48b5-a8f1-e0de19b94b50),volume_type_id=5f344141-3bc7-48b5-a8f1-e0de19b94b50)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Creating volume 3b902b2e-67bb-4be2-b306-0a293c8efbc9 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:28:32 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:32 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 1073741824
Jul 06 13:28:32 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43ce2bf5-c77f-4a8b-a299-a22d391cd3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e46478e-b753-422d-a9f6-4727eb01056f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5aa37b-5e0d-423e-babf-80bde44bc4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume volume-0e46478e-b753-422d-a9f6-4727eb01056f (0e46478e-b753-422d-a9f6-4727eb01056f): created successfully
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff5aa37b-5e0d-423e-babf-80bde44bc4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (1342f5a8-7b28-4435-9412-09d3b3e7c660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1727d444-ffd2-45c1-ab93-3302bfe3fa29 tempest-TestInstancesWithCinderVolumes-525683372 None] Created volume successfully.
Jul 06 13:28:33 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 1073741824" returned: 0 in 0.944s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:33 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9
Jul 06 13:28:33 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:34 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9" returned: 0 in 0.779s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.346s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Creating offline snapshot 9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 of volume f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8734d9f-2496-4e09-87b2-7fd319275902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df90c47-44f3-4b55-b925-d73512ecb548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc9edc-3472-451c-b89c-89c64b2b7e70]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Volume volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 (3b902b2e-67bb-4be2-b306-0a293c8efbc9): created successfully
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df90c47-44f3-4b55-b925-d73512ecb548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (4e3192e2-3536-4c5d-9407-96ed0ea44964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b872e8df-c9d8-4869-912f-dc51813d7807 tempest-TestInstancesWithCinderVolumes-525683372 None] Created volume successfully.
Jul 06 13:28:34 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:34 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:35 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 1.048s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:35 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 1G
Jul 06 13:28:35 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:36 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD, size 20.69 MB, duration 4.34 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:28:36 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Image download 20.69 MB at 4.76 MB/s
Jul 06 13:28:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741ea6b-6daa-48d9-92fc-e8432015f7fa]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:36 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD
Jul 06 13:28:36 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:36 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 1G" returned: 0 in 1.101s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f252918c-2ced-4555-9a93-b56a5c2e1739 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:36 devstack sudo[98295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f252918c-2ced-4555-9a93-b56a5c2e1739 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8
Jul 06 13:28:36 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:37 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD" returned: 0 in 1.022s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Temporary image 8b09ed05-0004-4a30-9dba-14e071ba5bec is fetched for user 389cd5164d2b46299971464f7ddac212. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[331a0d9c-141a-4e1a-a416-aafb1ea586d3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:37 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f252918c-2ced-4555-9a93-b56a5c2e1739 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" returned: 0 in 1.075s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:37 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 is being set with open permissions: ugo+rw
Jul 06 13:28:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:37 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8
Jul 06 13:28:37 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:37 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD
Jul 06 13:28:37 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:38 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" returned: 0 in 0.918s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:38 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD" returned: 0 in 1.068s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:38 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info
Jul 06 13:28:38 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:39 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info" returned: 0 in 0.701s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:39 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info is being set with open permissions: ugo+rw
Jul 06 13:28:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:39 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info
Jul 06 13:28:39 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:40 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.info" returned: 0 in 0.786s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.758s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1439576954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5de10b-40c3-4f1a-b95c-8e167fb8cb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad53e7dcbb4cd0a364fa9f6867f6da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:28:32Z,use_quota=True,user_id='389cd5164d2b46299971464f7ddac212',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a42537a8-3b28-4e32-8964-9fc93ce24897),volume_type_id=a42537a8-3b28-4e32-8964-9fc93ce24897)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Creating volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:28:40 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:28:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:40 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1073741824
Jul 06 13:28:40 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3185bae7-ed2a-41d7-96d2-52ecb8ac78a2 tempest-VolumesExtendTest-692535333 None] Create snapshot completed successfully
Jul 06 13:28:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:41 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1073741824" returned: 0 in 0.892s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:41 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:28:41 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:42 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 0.959s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.032s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deee2aa-b3b2-4cff-8381-761badb90a74]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Attempting download of 8b09ed05-0004-4a30-9dba-14e071ba5bec ((None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}])) to volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:28:42 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:42 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[331cad66-350b-457c-a16b-20e859b6f06b]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:42 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2
Jul 06 13:28:42 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:43 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 1.021s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 2G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:43 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2" returned: 0 in 0.980s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:43 devstack sudo[98787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2
Jul 06 13:28:43 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 2G" returned: 0 in 0.216s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.310s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-57a21d3f-8073-46a8-a3f6-cf8215bd0df1 tempest-VolumesExtendTest-692535333 None] Extend volume completed successfully.
Jul 06 13:28:44 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2" returned: 1 in 1.231s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8b09ed05-0004-4a30-9dba-14e071ba5bec_62_bpfe2' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c7f3ac-7448-4db9-83be-4d5ab2e9774d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:44 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD
Jul 06 13:28:44 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-quobyte-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Deleting offline snapshot 9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 of volume f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] snapshot_file for this snap is: volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6cd1a-ff91-4dad-9816-9ab65ce6d008]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:45 devstack sudo[98800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8
Jul 06 13:28:45 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:46 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD" returned: 0 in 1.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] 8b09ed05-0004-4a30-9dba-14e071ba5bec was qcow2, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:46 devstack sudo[98824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:28:46 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:46 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" returned: 0 in 1.627s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f252918c-2ced-4555-9a93-b56a5c2e1739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddae9c6-f1b4-4cc1-895a-d249698077ae]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:46 devstack sudo[98826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:46 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:47 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 1.034s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:47 devstack sudo[98841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8
Jul 06 13:28:47 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:48 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" returned: 0 in 1.055s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:48 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8
Jul 06 13:28:48 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:49 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 2.720s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8b09ed05-0004-4a30-9dba-14e071ba5bec_g4_0e8uzdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:28:49 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Converted 112.00 MB image at 41.15 MB/s
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:49 devstack sudo[98849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1G
Jul 06 13:28:49 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:49 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739.9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8" released by "_delete_snapshot" :: held 4.704s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" released by "delete_snapshot" :: held 4.759s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Created reservations ['9bcc5aae-aff2-42b9-8277-27041b6972a7', '6796a2d2-f69e-4942-a440-b60be0d2f390', 'e2c80377-f1bf-4110-9484-ad2bec8fd3df', '7d8ca704-b3ce-4b68-abd1-3a2702c68dcb'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:28:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Delete snapshot completed successfully.
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43e1349a-37b1-4ffe-a491-d8411493e4a6 tempest-VolumesExtendTest-692535333 None] Lock "cinder-9c8ccf15-f3be-4c3f-8d63-f1df8c8707a8-delete_snapshot" released by "delete_snapshot" :: held 4.964s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:49 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 1G" returned: 0 in 0.847s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace40a8-9036-4d48-a96f-e5b23e40543f]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:50 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:28:50 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-f252918c-2ced-4555-9a93-b56a5c2e1739-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "cinder-f252918c-2ced-4555-9a93-b56a5c2e1739-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Acquiring lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c070ac92-bf2c-4c36-821d-7f6f6f8688af]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:28:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:51 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:51 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:51 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 1.322s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:51 devstack sudo[98904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:28:51 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:52 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 1.407s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:52 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739
Jul 06 13:28:52 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:52 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 1 in 1.503s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Downloaded image 8b09ed05-0004-4a30-9dba-14e071ba5bec ((None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}])) to volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Temporary image 8b09ed05-0004-4a30-9dba-14e071ba5bec for user 389cd5164d2b46299971464f7ddac212 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Marking volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Copying metadata from image 8b09ed05-0004-4a30-9dba-14e071ba5bec to 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:28:52 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Creating volume glance metadata for volume 7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 backed by image 8b09ed05-0004-4a30-9dba-14e071ba5bec with: {'image_id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'image_name': 'tempest-scenario-img--652402050', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49264e5a-f890-48e2-8292-fc3560a3c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55', 'volume_size': 1, 'image_id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8b09ed05-0004-4a30-9dba-14e071ba5bec', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--652402050', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1ad53e7dcbb4cd0a364fa9f6867f6da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8b09ed05-0004-4a30-9dba-14e071ba5bec', 'created_at': datetime.datetime(2026, 7, 6, 11, 28, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 28, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8b09ed05-0004-4a30-9dba-14e071ba5bec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599578890>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6670ef-f7b3-41eb-b6d7-7df4a397a501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:28:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Volume volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 (7e5de10b-40c3-4f1a-b95c-8e167fb8cb55): created successfully
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6670ef-f7b3-41eb-b6d7-7df4a397a501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Flow 'volume_create_manager' (90191dee-012f-4bd6-8b37-562015d8c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:28:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-dadda273-e739-459d-8339-17782f3c402e tempest-TestInstancesWithCinderVolumes-525683372 None] Created volume successfully.
Jul 06 13:28:53 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f252918c-2ced-4555-9a93-b56a5c2e1739" returned: 0 in 0.866s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "cinder-quobyte-f252918c-2ced-4555-9a93-b56a5c2e1739" released by "delete_volume" :: held 2.379s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Created reservations ['52b76aab-403e-482a-b858-6acb64dd6404', 'bcdd849c-7da3-4739-bf00-53f51f339f13', '3bae4ac0-339c-4a9e-8e5c-b4a895ef3ab1', '17510e54-d2af-4b9e-8e47-0512ba02ba11'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:28:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:28:53 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:28:53 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:28:54 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Jul 06 13:28:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.932s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:28:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:28:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Deleted volume successfully.
Jul 06 13:28:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3959e6ce-14ca-48c1-a8a4-fa6286d9cae4 tempest-VolumesExtendTest-692535333 None] Lock "cinder-f252918c-2ced-4555-9a93-b56a5c2e1739-delete_volume" released by "delete_volume" :: held 3.886s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:29:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[365aba34-af69-44d7-8108-9e2c436d4214]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:29:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:04 devstack sudo[99003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:29:04 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:05 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 1.375s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:05 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:29:05 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:06 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 1 in 0.909s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:29:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.361s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:06 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=51,cinder:INSERT=20,cinder:UPDATE=42,cinder:DELETE=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:29:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ba762b2-cf6f-4336-97ac-6da0c52a18f5', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:29:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-f008224c-fd72-4d13-8f42-bfc1d71db633 req-f781e8f4-207f-43be-8503-c4b15780dbbc tempest-TestInstancesWithCinderVolumes-525683372 None] attachment_update completed successfully.
Jul 06 13:29:16 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=38,cinder:UPDATE=32,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:29:16 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:18 devstack sudo[99146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:29:18 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:19 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (9a472e3d-46f2-4e26-b2cb-72a4520a7f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386e83b8-b2de-47e1-96c6-98feb27fcdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.348s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386e83b8-b2de-47e1-96c6-98feb27fcdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168838443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7af3bd5-f32f-45d3-bd24-5afb7badeabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:29:20Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1ea652-63e3-4e92-842e-1a0cd67e2c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1ea652-63e3-4e92-842e-1a0cd67e2c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411ed6f-bb80-4cbe-8879-da5d738fc0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6411ed6f-bb80-4cbe-8879-da5d738fc0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7af3bd5-f32f-45d3-bd24-5afb7badeabb', 'volume_name': 'volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ca184c-d04f-4352-913b-56957d416d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ca184c-d04f-4352-913b-56957d416d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25380148-2226-4fdb-ad11-3eab5a1b313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:19 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Volume f7af3bd5-f32f-45d3-bd24-5afb7badeabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb', 'volume_size': 1}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1168838443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7af3bd5-f32f-45d3-bd24-5afb7badeabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:29:20Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Creating volume f7af3bd5-f32f-45d3-bd24-5afb7badeabb {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:29:19 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:29:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:20 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb 1073741824
Jul 06 13:29:20 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:21 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb 1073741824" returned: 0 in 1.219s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:21 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb
Jul 06 13:29:21 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:22 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" returned: 0 in 1.140s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25380148-2226-4fdb-ad11-3eab5a1b313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b24334-faaf-4fe9-ab19-33b6f5302838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:29:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Volume volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb (f7af3bd5-f32f-45d3-bd24-5afb7badeabb): created successfully
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b24334-faaf-4fe9-ab19-33b6f5302838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:29:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (9a472e3d-46f2-4e26-b2cb-72a4520a7f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:29:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9e5e8f71-2f1b-46d3-bae8-3fa1c7797e60 tempest-AttachVolumeNegativeTest-134439578 None] Created volume successfully.
Jul 06 13:29:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:26 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0be420-8bab-4a38-9989-e6f4dc789389]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:29:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:26 devstack sudo[99199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb
Jul 06 13:29:26 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:28 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" returned: 0 in 1.308s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.338s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb32474f-3b41-4a7f-a4a1-1730b93b5fd0', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:29:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-447a292d-7c29-4f58-afff-29f1d1a7e540 req-5eee9ff8-e619-403f-a704-229e90fcfcd6 tempest-AttachVolumeNegativeTest-134439578 None] attachment_update completed successfully.
Jul 06 13:29:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-4d2cf4b3-cf94-4242-9a43-465c33a6da82 tempest-TestShelveInstance-276568591 None] Terminate volume connection completed successfully.
Jul 06 13:29:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-4d2cf4b3-cf94-4242-9a43-465c33a6da82 tempest-TestShelveInstance-276568591 None] Deleting attachment 9e9558f3-7907-44aa-b6fd-9523975dfd2d. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Acquiring lock "cinder-d18ebd0d-66e6-48c5-b961-773ca154ee35-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "cinder-d18ebd0d-66e6-48c5-b961-773ca154ee35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Acquiring lock "cinder-quobyte-d18ebd0d-66e6-48c5-b961-773ca154ee35" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "cinder-quobyte-d18ebd0d-66e6-48c5-b961-773ca154ee35" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0caa7e-4025-40af-8d0b-d30f2e9d5f10]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:29:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:29 devstack sudo[99274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:29:29 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:30 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 1.404s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:31 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:29:31 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:31 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 1 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:29:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:31 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35
Jul 06 13:29:31 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:32 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d18ebd0d-66e6-48c5-b961-773ca154ee35" returned: 0 in 0.689s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "cinder-quobyte-d18ebd0d-66e6-48c5-b961-773ca154ee35" released by "delete_volume" :: held 3.036s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG cinder.quota [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Created reservations ['2a34ca3c-b6be-4f97-ba00-eac4d204464c', '1ec91665-1cb7-4b26-b39e-527ba10333c3', '30ab1033-ed81-410c-af21-3763ce0b1305', '282ff884-9009-419f-a04a-fd6922a71f2b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:32 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:29:32 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:33 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.840s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:33 devstack cinder-volume[86698]: DEBUG cinder.manager [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:29:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Deleted volume successfully.
Jul 06 13:29:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [req-4a90dc00-bc09-43ad-9ae2-eee12a6cf81e req-63c31f0f-b58c-449e-94e0-4f5f10fc2474 tempest-TestShelveInstance-276568591 None] Lock "cinder-d18ebd0d-66e6-48c5-b961-773ca154ee35-delete_volume" released by "delete_volume" :: held 4.215s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:29:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-bfb51705-f0c7-42da-aa45-d91e724d2e4f req-e314fc7e-1a43-4ca9-919b-2665ee555dc7 tempest-AttachVolumeNegativeTest-134439578 None] Terminate volume connection completed successfully.
Jul 06 13:29:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-bfb51705-f0c7-42da-aa45-d91e724d2e4f req-e314fc7e-1a43-4ca9-919b-2665ee555dc7 tempest-AttachVolumeNegativeTest-134439578 None] Deleting attachment cb32474f-3b41-4a7f-a4a1-1730b93b5fd0. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:29:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc666bf-168e-4b75-b5f7-49dfdb061935]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:29:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:43 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f
Jul 06 13:29:43 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:43 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f" returned: 0 in 0.923s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.945s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-0e46478e-b753-422d-a9f6-4727eb01056f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fabc238-1d37-4850-9b1c-7cab6bcbccd0', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:29:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-5f3ea6f0-b110-4113-907d-58a4855e3fa0 req-a8693012-4de9-443b-ba8f-bb9f1ac2b7b8 tempest-TestInstancesWithCinderVolumes-525683372 None] attachment_update completed successfully.
Jul 06 13:29:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:29:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:29:53 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41c7b6-24bf-44bb-a8ed-5814c163bbea]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:29:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:29:53 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9
Jul 06 13:29:53 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:29:53 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:29:55 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Jul 06 13:29:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9" returned: 0 in 1.766s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:29:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.804s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:29:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '996a0c5a-6415-4f03-9203-fc7df8822852', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:29:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-be909ae0-d186-43b9-a1f4-fc9dc5397e5f req-c70c6737-5016-449e-86d0-359b27941732 tempest-TestInstancesWithCinderVolumes-525683372 None] attachment_update completed successfully.
Jul 06 13:30:05 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=16,cinder:SELECT=29,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:30:05 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:30:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-b3884e20-485c-413f-9f13-c77065b0878f req-6a87d22c-6265-4080-af3e-05dd85fb9a9b tempest-TestInstancesWithCinderVolumes-525683372 None] Terminate volume connection completed successfully.
Jul 06 13:30:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-b3884e20-485c-413f-9f13-c77065b0878f req-6a87d22c-6265-4080-af3e-05dd85fb9a9b tempest-TestInstancesWithCinderVolumes-525683372 None] Deleting attachment 1fabc238-1d37-4850-9b1c-7cab6bcbccd0. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-0e46478e-b753-422d-a9f6-4727eb01056f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-0e46478e-b753-422d-a9f6-4727eb01056f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-quobyte-0e46478e-b753-422d-a9f6-4727eb01056f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-0e46478e-b753-422d-a9f6-4727eb01056f" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f268142c-8b8e-41d2-bc67-e70d9977a096]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:10 devstack sudo[99646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f
Jul 06 13:30:10 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:11 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f" returned: 0 in 1.293s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:11 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f
Jul 06 13:30:11 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:11 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0e46478e-b753-422d-a9f6-4727eb01056f" returned: 0 in 0.903s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-0e46478e-b753-422d-a9f6-4727eb01056f" released by "delete_volume" :: held 2.283s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:12 devstack cinder-volume[86698]: WARNING cinder.quota [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2123759521-1193801818 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2123759521-1193801818, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:12 devstack cinder-volume[86698]: WARNING cinder.quota [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2123759521-1193801818 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2123759521-1193801818, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Created reservations ['6fe8b406-4b8f-46c4-b75e-2d6a6fb168f2', '86eded96-dc45-4e91-b747-8f53f709415e', '8161795d-6a03-4c0a-bd1c-c4b7c6051831', 'ae47ee5c-147d-4149-9d82-917247fefe80'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:12 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:30:12 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:13 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.278s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:13 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:30:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deleted volume successfully.
Jul 06 13:30:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-647c9837-8762-4c3c-a383-f511be03bae8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-0e46478e-b753-422d-a9f6-4727eb01056f-delete_volume" released by "delete_volume" :: held 3.992s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-443c0321-0f42-4935-b1da-57e1868db952 req-921d7a0a-a657-4361-be45-8ecb7e132012 tempest-TestInstancesWithCinderVolumes-525683372 None] Terminate volume connection completed successfully.
Jul 06 13:30:16 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-443c0321-0f42-4935-b1da-57e1868db952 req-921d7a0a-a657-4361-be45-8ecb7e132012 tempest-TestInstancesWithCinderVolumes-525683372 None] Deleting attachment 996a0c5a-6415-4f03-9203-fc7df8822852. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-3b902b2e-67bb-4be2-b306-0a293c8efbc9-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-3b902b2e-67bb-4be2-b306-0a293c8efbc9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:18 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:30:18 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-quobyte-3b902b2e-67bb-4be2-b306-0a293c8efbc9" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-3b902b2e-67bb-4be2-b306-0a293c8efbc9" acquired by "delete_volume" :: waited 0.045s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d6192-1689-474f-8a18-adf800364a0b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:19 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9
Jul 06 13:30:19 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Flow 'volume_create_manager' (dd5a5343-069f-4ab0-81c1-36931d056a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef7c250-807a-49f6-9fa2-318af23c3af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef7c250-807a-49f6-9fa2-318af23c3af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2049553034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638d1ba3-fa33-422c-bfbc-0e3d5c788f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391b4c8caa74c5da722f36bff40d9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:19Z,use_quota=True,user_id='b3c3a49042e84b46ae681a341aec5b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c1d7d7-2fa9-4763-8256-7be2c378f245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c1d7d7-2fa9-4763-8256-7be2c378f245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d74074-fcc2-4edc-82e3-a37a4db89dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d74074-fcc2-4edc-82e3-a37a4db89dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '638d1ba3-fa33-422c-bfbc-0e3d5c788f42', 'volume_name': 'volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90a40cd-5b1c-45fd-bf62-7a42582445fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90a40cd-5b1c-45fd-bf62-7a42582445fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84186b73-4047-4d0a-96cd-f1e607d75b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:19 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Volume 638d1ba3-fa33-422c-bfbc-0e3d5c788f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42', 'volume_size': 1}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2049553034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638d1ba3-fa33-422c-bfbc-0e3d5c788f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0391b4c8caa74c5da722f36bff40d9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:19Z,use_quota=True,user_id='b3c3a49042e84b46ae681a341aec5b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Creating volume 638d1ba3-fa33-422c-bfbc-0e3d5c788f42 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:30:19 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:30:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:19 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 1073741824
Jul 06 13:30:19 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:20 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9" returned: 0 in 1.602s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:20 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9
Jul 06 13:30:20 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:20 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.101s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:30:20 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 1073741824" returned: 0 in 1.608s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:21 devstack sudo[99727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42
Jul 06 13:30:21 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:21 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3b902b2e-67bb-4be2-b306-0a293c8efbc9" returned: 0 in 1.144s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-3b902b2e-67bb-4be2-b306-0a293c8efbc9" released by "delete_volume" :: held 2.837s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:21 devstack cinder-volume[86698]: WARNING cinder.quota [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1993160138-1572010941 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1993160138-1572010941, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:21 devstack cinder-volume[86698]: WARNING cinder.quota [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1993160138-1572010941 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1993160138-1572010941, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Created reservations ['0e531fdf-57bd-4387-97b8-04cac53366c7', 'c126319e-bc7b-46bc-9630-1818156010ba', '0e223e7e-ee1b-48a8-bd8e-48a7066b9349', '2e2e7191-84f0-4fc7-9217-58ea5e846db7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:21 devstack sudo[99731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:30:21 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:22 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" returned: 0 in 1.354s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] <== create_volume: return (3053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.056s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84186b73-4047-4d0a-96cd-f1e607d75b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1847ee3e-a547-4ee4-8548-99c11a7c3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Volume volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 (638d1ba3-fa33-422c-bfbc-0e3d5c788f42): created successfully
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1847ee3e-a547-4ee4-8548-99c11a7c3691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Flow 'volume_create_manager' (dd5a5343-069f-4ab0-81c1-36931d056a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-99de4d1b-0b85-44b6-900c-fbf5bd5b29a9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Created volume successfully.
Jul 06 13:30:23 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.199s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:23 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:30:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Deleted volume successfully.
Jul 06 13:30:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-662b5563-0287-4856-87f5-633d8e9baeb1 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-3b902b2e-67bb-4be2-b306-0a293c8efbc9-delete_volume" released by "delete_volume" :: held 4.721s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Flow 'volume_create_manager' (808b8af9-e47f-4089-8799-0329fd4cb6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d7e81-7a67-4336-a9cc-e7e442bea4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38d7e81-7a67-4336-a9cc-e7e442bea4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-562845319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d47fd2-d4ce-404f-871d-e2855f35aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a8942c81f4c688848f017a5346860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:24Z,use_quota=True,user_id='268d945f74ea409e9d6c1c166966def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc278aa-75eb-4982-95c3-b202bd79ddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc278aa-75eb-4982-95c3-b202bd79ddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cd7891-396b-4eba-bdde-721733b9293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cd7891-396b-4eba-bdde-721733b9293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7d47fd2-d4ce-404f-871d-e2855f35aab1', 'volume_name': 'volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f5a7d-7c0f-45c9-b92d-96820cde8b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7f5a7d-7c0f-45c9-b92d-96820cde8b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff21511-2a70-4e6c-8882-c362a8ea8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:24 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Volume e7d47fd2-d4ce-404f-871d-e2855f35aab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1', 'volume_size': 1}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-562845319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7d47fd2-d4ce-404f-871d-e2855f35aab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a8942c81f4c688848f017a5346860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:24Z,use_quota=True,user_id='268d945f74ea409e9d6c1c166966def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Creating volume e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:30:24 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:30:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:24 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 1073741824
Jul 06 13:30:24 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:25 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 1073741824" returned: 0 in 1.243s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:25 devstack sudo[99790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:30:25 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:26 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 0.750s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ff21511-2a70-4e6c-8882-c362a8ea8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a74a6-5361-4698-92eb-a4572195d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Volume volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 (e7d47fd2-d4ce-404f-871d-e2855f35aab1): created successfully
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91a74a6-5361-4698-92eb-a4572195d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Flow 'volume_create_manager' (808b8af9-e47f-4089-8799-0329fd4cb6d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3959abe5-22ad-40f3-b4d7-859d59e28d5e tempest-TestStampPattern-341745948 None] Created volume successfully.
Jul 06 13:30:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f5f53-ee35-4c30-a5fe-3a542373616f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:27 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42
Jul 06 13:30:27 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:28 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" returned: 0 in 1.001s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.029s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5169265d-7621-4a0e-928b-95a27e1ee5e5', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:30:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-972477f1-cba6-4867-b9d5-fbfe35d296a3 req-8dad57a6-a63a-412a-8711-05ca22ea9ab9 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] attachment_update completed successfully.
Jul 06 13:30:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-f8d027ee-dd36-49c9-bf2f-e8218a463034 req-a7641332-304e-4b8c-8691-09565915c06d tempest-TestInstancesWithCinderVolumes-525683372 None] Terminate volume connection completed successfully.
Jul 06 13:30:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-f8d027ee-dd36-49c9-bf2f-e8218a463034 req-a7641332-304e-4b8c-8691-09565915c06d tempest-TestInstancesWithCinderVolumes-525683372 None] Deleting attachment 0ba762b2-cf6f-4336-97ac-6da0c52a18f5. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "cinder-quobyte-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[38478185-b545-4826-a05c-898d2d04f9cb]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:33 devstack sudo[100231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:30:33 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:34 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 0.936s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:34 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:30:34 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:35 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 1 in 0.802s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:30:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:35 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55
Jul 06 13:30:35 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-19702514-76ed-458d-b352-3b5804a10081 req-9c2772c5-e3fe-4ef3-a525-dd642fc12976 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Terminate volume connection completed successfully.
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-19702514-76ed-458d-b352-3b5804a10081 req-9c2772c5-e3fe-4ef3-a525-dd642fc12976 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Deleting attachment 5169265d-7621-4a0e-928b-95a27e1ee5e5. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:30:36 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" returned: 0 in 1.147s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-quobyte-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55" released by "delete_volume" :: held 2.951s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:36 devstack cinder-volume[86698]: WARNING cinder.quota [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071390757-749204899 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071390757-749204899, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:36 devstack cinder-volume[86698]: WARNING cinder.quota [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071390757-749204899 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1071390757-749204899, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Created reservations ['d70e1f9b-2aeb-47b3-82b1-4dc774ee7840', '0bc10ad2-123a-419f-9708-89e4716231c4', 'df906cca-513f-4515-814c-2a762b5711a7', '7eaf6a14-424b-4cfd-879e-53f82f124153'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:36 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:30:36 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (6a89357d-662f-4d3a-b1ff-48250b4c19b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd85a35-2a6b-4557-9e28-1c6dce8271d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd85a35-2a6b-4557-9e28-1c6dce8271d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1795940192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0585ee7f-5dba-419e-a71d-160b980fe3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:37Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6751ad9-4be7-4bf0-9f9e-463eab2b3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6751ad9-4be7-4bf0-9f9e-463eab2b3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63823c0d-a17b-4d64-9aab-283c72248dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63823c0d-a17b-4d64-9aab-283c72248dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0585ee7f-5dba-419e-a71d-160b980fe3b7', 'volume_name': 'volume-0585ee7f-5dba-419e-a71d-160b980fe3b7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3c32b-5149-4205-a35b-d37123ae9379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3c32b-5149-4205-a35b-d37123ae9379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dadc434-7b7d-4db3-82fd-4c647077af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:37 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Volume 0585ee7f-5dba-419e-a71d-160b980fe3b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0585ee7f-5dba-419e-a71d-160b980fe3b7', 'volume_size': 1}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1795940192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0585ee7f-5dba-419e-a71d-160b980fe3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c53f95c4b6b64ca8b8453fac7e459cce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:30:37Z,use_quota=True,user_id='89445397aed64b7c96aaaac8712aca93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Creating volume 0585ee7f-5dba-419e-a71d-160b980fe3b7 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:30:37 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:37 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 1073741824
Jul 06 13:30:37 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:37 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:30:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Deleted volume successfully.
Jul 06 13:30:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7489c900-3446-4e91-996f-ff320801ada8 tempest-TestInstancesWithCinderVolumes-525683372 None] Lock "cinder-7e5de10b-40c3-4f1a-b95c-8e167fb8cb55-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "cinder-638d1ba3-fa33-422c-bfbc-0e3d5c788f42-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:38 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 1073741824" returned: 0 in 1.219s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "cinder-638d1ba3-fa33-422c-bfbc-0e3d5c788f42-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:38 devstack sudo[100348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7
Jul 06 13:30:38 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "cinder-quobyte-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "cinder-quobyte-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[87547016-843a-4283-b1ad-1cb450e0453f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:38 devstack sudo[100350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42
Jul 06 13:30:38 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:39 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7" returned: 0 in 1.257s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dadc434-7b7d-4db3-82fd-4c647077af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0585ee7f-5dba-419e-a71d-160b980fe3b7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517cac0b-c484-4eb7-b36c-ee05d7d91682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:30:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Volume volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 (0585ee7f-5dba-419e-a71d-160b980fe3b7): created successfully
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517cac0b-c484-4eb7-b36c-ee05d7d91682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Flow 'volume_create_manager' (6a89357d-662f-4d3a-b1ff-48250b4c19b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:30:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c10c2114-e404-4761-992c-0573a378dcd2 tempest-AttachVolumeNegativeTest-134439578 None] Created volume successfully.
Jul 06 13:30:39 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" returned: 0 in 1.250s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:39 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42
Jul 06 13:30:39 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:41 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" returned: 0 in 1.077s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "cinder-quobyte-638d1ba3-fa33-422c-bfbc-0e3d5c788f42" released by "delete_volume" :: held 2.376s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Created reservations ['dac7c938-512f-40cb-a38b-05ecee159101', '1e540f7e-f313-45e1-ae13-a14339e7a871', '4ce416a2-672f-4b27-aa97-d204d30fe852', '983fa93e-6838-4a4f-95e8-8401fabdd65e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:41 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:30:41 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:42 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.183s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:42 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:30:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Deleted volume successfully.
Jul 06 13:30:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ce52404-29b7-4ab8-8a67-00136db42a72 tempest-TestServerVolumeAttachScenarioOldVersion-1106650762 None] Lock "cinder-638d1ba3-fa33-422c-bfbc-0e3d5c788f42-delete_volume" released by "delete_volume" :: held 3.989s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:30:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:30:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:30:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec7ca3f-265b-4aac-8cf4-a72c88c1a5e1]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:30:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:30:44 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7
Jul 06 13:30:44 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:30:45 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jul 06 13:30:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7" returned: 0 in 1.427s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:30:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.541s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:30:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-0585ee7f-5dba-419e-a71d-160b980fe3b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a1ad411-f136-4690-80a4-1cf97a274568', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:30:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-810b271d-fca7-4b4b-8fe9-915e815a0380 req-db128b36-3950-481b-bad5-8b1d893a8523 tempest-AttachVolumeNegativeTest-134439578 None] attachment_update completed successfully.
Jul 06 13:30:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-7cf977f5-18f1-4dbb-a91d-f52eacb2b906 req-1bfb8cf5-2cc4-4941-9114-6938184e5b1e tempest-AttachVolumeNegativeTest-134439578 None] Terminate volume connection completed successfully.
Jul 06 13:30:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-7cf977f5-18f1-4dbb-a91d-f52eacb2b906 req-1bfb8cf5-2cc4-4941-9114-6938184e5b1e tempest-AttachVolumeNegativeTest-134439578 None] Deleting attachment 0a1ad411-f136-4690-80a4-1cf97a274568. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:31:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=50,cinder:INSERT=9,cinder:UPDATE=48,cinder:DELETE=2 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:31:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=35,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:31:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ddbd6d-a0bf-468d-bd52-e65f484693c5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:08 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:31:08 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-0585ee7f-5dba-419e-a71d-160b980fe3b7-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-0585ee7f-5dba-419e-a71d-160b980fe3b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Flow 'volume_create_manager' (62ac6995-a8f5-400f-b1a0-5626d6771e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7784d357-e262-41c1-bcc3-3993109a7af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-quobyte-0585ee7f-5dba-419e-a71d-160b980fe3b7" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7784d357-e262-41c1-bcc3-3993109a7af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206643616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85342da3-63e6-4c5d-8a0c-a2811301e675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8b0a7efbf482fb75164ff13ebdd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:10Z,use_quota=True,user_id='c9eafc229f164af98dfe3e0fe6c6f74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774fee62-7527-47b5-bf6d-b3e2f77e79b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774fee62-7527-47b5-bf6d-b3e2f77e79b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54870447-3685-4fe3-ac0d-cdf3df360026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54870447-3685-4fe3-ac0d-cdf3df360026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85342da3-63e6-4c5d-8a0c-a2811301e675', 'volume_name': 'volume-85342da3-63e6-4c5d-8a0c-a2811301e675', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3321155e-fa0d-4126-b412-4424c872a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3321155e-fa0d-4126-b412-4424c872a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffcd088-2d96-4205-bd76-669f4f7c163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Volume 85342da3-63e6-4c5d-8a0c-a2811301e675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85342da3-63e6-4c5d-8a0c-a2811301e675', 'volume_size': 1}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-0585ee7f-5dba-419e-a71d-160b980fe3b7" acquired by "delete_volume" :: waited 0.076s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:09 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 1.168s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.197s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206643616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85342da3-63e6-4c5d-8a0c-a2811301e675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8b0a7efbf482fb75164ff13ebdd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:10Z,use_quota=True,user_id='c9eafc229f164af98dfe3e0fe6c6f74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Creating volume 85342da3-63e6-4c5d-8a0c-a2811301e675 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:09 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ab42c-c920-4395-98a2-2c8fc1a096f0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:09 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 1073741824
Jul 06 13:31:09 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8a1e63b-944d-45f1-87f9-df8cc6c7e27f', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:31:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-1902d141-c912-4d1d-8379-984f0830ebe6 req-39ef4797-58f7-49fa-adbb-91fccc48f4c3 tempest-TestStampPattern-341745948 None] attachment_update completed successfully.
Jul 06 13:31:10 devstack sudo[100930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7
Jul 06 13:31:10 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:10 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7" returned: 0 in 1.014s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:10 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7
Jul 06 13:31:10 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:11 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 1073741824" returned: 0 in 1.192s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:11 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675
Jul 06 13:31:11 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:11 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0585ee7f-5dba-419e-a71d-160b980fe3b7" returned: 0 in 0.842s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-0585ee7f-5dba-419e-a71d-160b980fe3b7" released by "delete_volume" :: held 1.938s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Created reservations ['41403243-d189-4000-91f3-632bd516a1ae', '76f27cf4-1331-4724-8c97-de3ae66a8078', '1b3b290c-0932-4751-b288-3b5ed1e96414', 'b0761e59-028a-497d-8dd3-f460837a55b4'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:11 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675" returned: 0 in 0.792s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffcd088-2d96-4205-bd76-669f4f7c163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85342da3-63e6-4c5d-8a0c-a2811301e675', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c82ec-2e04-4068-9dcb-6a8c34f6bb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Volume volume-85342da3-63e6-4c5d-8a0c-a2811301e675 (85342da3-63e6-4c5d-8a0c-a2811301e675): created successfully
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8c82ec-2e04-4068-9dcb-6a8c34f6bb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Flow 'volume_create_manager' (62ac6995-a8f5-400f-b1a0-5626d6771e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:11 devstack sudo[101331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:12 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-aece4e97-4b3c-4f14-ac90-c3b389d7b7fb tempest-ProjectReaderTests-1159828743 None] Created volume successfully.
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-f7af3bd5-f32f-45d3-bd24-5afb7badeabb-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-f7af3bd5-f32f-45d3-bd24-5afb7badeabb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-quobyte-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82e7f78-e37e-47f9-a10b-5f45ac9e4605]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:12 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb
Jul 06 13:31:12 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:12 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.779s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Deleted volume successfully.
Jul 06 13:31:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ef5cb374-a1bc-49e6-b896-e04b4e9af537 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-0585ee7f-5dba-419e-a71d-160b980fe3b7-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:13 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" returned: 0 in 0.832s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:13 devstack sudo[101340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb
Jul 06 13:31:13 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "cinder-85342da3-63e6-4c5d-8a0c-a2811301e675-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-85342da3-63e6-4c5d-8a0c-a2811301e675-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "cinder-quobyte-85342da3-63e6-4c5d-8a0c-a2811301e675" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-quobyte-85342da3-63e6-4c5d-8a0c-a2811301e675" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa61ca-d162-4345-aa9e-b2e634a37143]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:13 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675
Jul 06 13:31:13 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:14 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" returned: 0 in 0.971s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-f7af3bd5-f32f-45d3-bd24-5afb7badeabb" released by "delete_volume" :: held 1.863s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Created reservations ['0253c78b-1b2c-4e10-a34d-5c5eb9aeef00', '21b01ac4-b14f-4e0a-ae0a-74b60e3b5cf4', '62e24229-a835-4217-9322-c354760f181c', '7386037d-f6d5-40f0-bfa6-d955843749d6'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:14 devstack sudo[101345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:14 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:14 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675" returned: 0 in 1.074s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:14 devstack sudo[101350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675
Jul 06 13:31:14 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-d66a1848-1c37-49db-b18d-d454385f4a3c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-d66a1848-1c37-49db-b18d-d454385f4a3c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "cinder-quobyte-d66a1848-1c37-49db-b18d-d454385f4a3c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-d66a1848-1c37-49db-b18d-d454385f4a3c" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cdcce5-2e27-442f-9d2a-acedaee30ba6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:15 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.912s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Deleted volume successfully.
Jul 06 13:31:15 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c
Jul 06 13:31:15 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-16c26208-130e-4430-bd7a-3323e119fbe5 tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-f7af3bd5-f32f-45d3-bd24-5afb7badeabb-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:15 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-85342da3-63e6-4c5d-8a0c-a2811301e675" returned: 0 in 1.040s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-quobyte-85342da3-63e6-4c5d-8a0c-a2811301e675" released by "delete_volume" :: held 2.183s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Created reservations ['c1235429-2878-4078-baeb-00a73ed289e4', 'a7d738d0-5ef6-49b9-be3e-ed45dff1a284', '8f04a409-7dec-4c4f-8ae4-d1be0821081e', '73fccf74-993b-41b6-ad43-d444b4ca948c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:15 devstack sudo[101366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:15 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:16 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c" returned: 0 in 1.098s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:16 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c
Jul 06 13:31:16 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:16 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.890s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:16 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Deleted volume successfully.
Jul 06 13:31:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-101a2bba-21b8-4f54-a726-56f669926e08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-85342da3-63e6-4c5d-8a0c-a2811301e675-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:17 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d66a1848-1c37-49db-b18d-d454385f4a3c" returned: 0 in 0.974s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-quobyte-d66a1848-1c37-49db-b18d-d454385f4a3c" released by "delete_volume" :: held 2.138s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Created reservations ['15caa02f-2759-4ea7-9cd3-2bcbbadcc12f', '8793074a-cd89-4106-9547-568dbcb5f48c', '6b47eef4-343e-4aa2-92f0-3bd628ec4f9a', 'aa46003f-afc7-4405-891f-90c35d04e8c1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:17 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:17 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Flow 'volume_create_manager' (5ff38907-c6fc-4e28-bc9c-d04122cf9e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80a87d2-3e91-4df7-a335-d8b30907f509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a80a87d2-3e91-4df7-a335-d8b30907f509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139990514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74218449-645e-478a-966a-7e441a150515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8b0a7efbf482fb75164ff13ebdd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:18Z,use_quota=True,user_id='c9eafc229f164af98dfe3e0fe6c6f74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae76318-6b2a-4c9e-8577-ccb91f277fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae76318-6b2a-4c9e-8577-ccb91f277fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7341c5c-8b90-4ee5-b98e-4b3dfed25406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7341c5c-8b90-4ee5-b98e-4b3dfed25406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74218449-645e-478a-966a-7e441a150515', 'volume_name': 'volume-74218449-645e-478a-966a-7e441a150515', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f5201-509e-4a8a-89dd-dbc9113a2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7f5201-509e-4a8a-89dd-dbc9113a2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c37142-c4b2-4fe4-8887-b3d65d03a420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:17 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Volume 74218449-645e-478a-966a-7e441a150515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74218449-645e-478a-966a-7e441a150515', 'volume_size': 1}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1139990514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74218449-645e-478a-966a-7e441a150515,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d8b0a7efbf482fb75164ff13ebdd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:18Z,use_quota=True,user_id='c9eafc229f164af98dfe3e0fe6c6f74c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Creating volume 74218449-645e-478a-966a-7e441a150515 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:17 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:31:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:17 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 1073741824
Jul 06 13:31:17 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:18 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Deleted volume successfully.
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-dec585bf-a5e0-4061-8be0-6ac13a56c38d tempest-AttachVolumeNegativeTest-134439578 None] Lock "cinder-d66a1848-1c37-49db-b18d-d454385f4a3c-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:18 devstack sudo[101396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:18 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:19 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 1073741824" returned: 0 in 1.290s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:19 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515
Jul 06 13:31:19 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:19 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.985s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:31:19 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515" returned: 0 in 0.853s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] <== create_volume: return (2202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:31:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c37142-c4b2-4fe4-8887-b3d65d03a420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74218449-645e-478a-966a-7e441a150515', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d0838d-ee46-420f-a665-cb38f3717df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Volume volume-74218449-645e-478a-966a-7e441a150515 (74218449-645e-478a-966a-7e441a150515): created successfully
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d0838d-ee46-420f-a665-cb38f3717df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Flow 'volume_create_manager' (5ff38907-c6fc-4e28-bc9c-d04122cf9e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-01e2d2ad-577a-47ee-9330-ee1774712c02 tempest-ProjectReaderTests-1159828743 None] Created volume successfully.
Jul 06 13:31:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-26fe0658-bf30-44d7-b30d-74b45d45f92e req-639c6a1a-90e5-46e6-827d-acc4f436876c tempest-TestStampPattern-341745948 None] Terminate volume connection completed successfully.
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-26fe0658-bf30-44d7-b30d-74b45d45f92e req-639c6a1a-90e5-46e6-827d-acc4f436876c tempest-TestStampPattern-341745948 None] Deleting attachment e8a1e63b-944d-45f1-87f9-df8cc6c7e27f. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "cinder-74218449-645e-478a-966a-7e441a150515-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-74218449-645e-478a-966a-7e441a150515-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "cinder-quobyte-74218449-645e-478a-966a-7e441a150515" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-quobyte-74218449-645e-478a-966a-7e441a150515" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afcd75a-9a8b-4f0e-97cf-6c5272a412bd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:21 devstack sudo[101438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515
Jul 06 13:31:21 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:22 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515" returned: 0 in 1.003s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:22 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515
Jul 06 13:31:22 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Flow 'volume_create_manager' (1fb8480e-652e-4144-aecd-9fab4c9ca5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f73a1fb-1f42-451e-bfc7-0f3175f4ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f73a1fb-1f42-451e-bfc7-0f3175f4ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1067164957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199b9949-8c8d-4275-902a-58fac1ea6f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a10823cd34f4c50b60f70c515817c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:23Z,use_quota=True,user_id='db57e438250744a4a70e9a1699a8e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d868aa-f440-4c9e-8315-a143f78d852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d868aa-f440-4c9e-8315-a143f78d852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e270086-5363-4953-9eec-dea4037208dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e270086-5363-4953-9eec-dea4037208dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199b9949-8c8d-4275-902a-58fac1ea6f8e', 'volume_name': 'volume-199b9949-8c8d-4275-902a-58fac1ea6f8e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21654160-bd7f-4e8c-89e5-8a04b9059e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21654160-bd7f-4e8c-89e5-8a04b9059e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad83a13-0547-41eb-a4ab-b379702580ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume 199b9949-8c8d-4275-902a-58fac1ea6f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199b9949-8c8d-4275-902a-58fac1ea6f8e', 'volume_size': 1}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Creating offline snapshot 41620857-8c17-4128-bc91-05ff6b3baeaa of volume e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eea42ac-eab5-4491-a1c2-6fe6397de1a7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:23 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-74218449-645e-478a-966a-7e441a150515" returned: 0 in 1.148s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-quobyte-74218449-645e-478a-966a-7e441a150515" released by "delete_volume" :: held 2.223s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Created reservations ['90c6dc9b-e1a4-4676-9b18-903032e3f447', '0551d244-019a-4919-8713-a6d795bd50e8', '19aac3ac-fcea-4e5d-a76d-af7c8728f818', '9fa1b17d-7e50-445b-93f8-bd681d5ad1e8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:23 devstack sudo[101447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:31:23 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Flow 'volume_create_manager' (a95b8d95-954f-4a24-9fe3-8b0f6851a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88db2f-b7ae-4eb9-9d79-87cd1bbc8f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88db2f-b7ae-4eb9-9d79-87cd1bbc8f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1924953660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4ae5cb-ad81-4a46-a952-10e8b74156bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a10823cd34f4c50b60f70c515817c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:23Z,use_quota=True,user_id='db57e438250744a4a70e9a1699a8e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b029d6e-f081-4d06-b6dc-53496765af38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b029d6e-f081-4d06-b6dc-53496765af38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d0ea94-82ee-4ff7-866e-dc1e21b63491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d0ea94-82ee-4ff7-866e-dc1e21b63491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4ae5cb-ad81-4a46-a952-10e8b74156bc', 'volume_name': 'volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba902f-04f6-4f0c-88b3-b2013386834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ba902f-04f6-4f0c-88b3-b2013386834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2838fe57-c18f-43d1-b005-ebed087ab50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume dc4ae5cb-ad81-4a46-a952-10e8b74156bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc', 'volume_size': 1}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:23 devstack sudo[101449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:23 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:24 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 1.147s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:24 devstack sudo[101455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa 1G
Jul 06 13:31:24 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:24 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.042s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Deleted volume successfully.
Jul 06 13:31:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7e07d446-6d30-4da5-861d-04c3ba8f0c08 tempest-ProjectReaderTests-1159828743 None] Lock "cinder-74218449-645e-478a-966a-7e441a150515-delete_volume" released by "delete_volume" :: held 3.812s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:25 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa 1G" returned: 0 in 1.014s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:25 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:31:25 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:26 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 0.889s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:26 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa is being set with open permissions: ugo+rw
Jul 06 13:31:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:26 devstack sudo[101469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:31:26 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:27 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 0.866s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:27 devstack sudo[101472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info
Jul 06 13:31:27 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:28 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info" returned: 0 in 0.994s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:28 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info is being set with open permissions: ugo+rw
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:28 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info
Jul 06 13:31:28 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:28 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.info" returned: 0 in 0.677s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.804s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.713s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1067164957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199b9949-8c8d-4275-902a-58fac1ea6f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a10823cd34f4c50b60f70c515817c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:23Z,use_quota=True,user_id='db57e438250744a4a70e9a1699a8e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Creating volume 199b9949-8c8d-4275-902a-58fac1ea6f8e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:28 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:31:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:28 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e 1073741824
Jul 06 13:31:28 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ceca3331-f0f0-41ed-b6ca-9203f9e7ee9c tempest-TestStampPattern-341745948 None] Create snapshot completed successfully
Jul 06 13:31:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-1c504f92-e479-406e-a6a2-cedebd6e91f9 tempest-BackendsCapabilitiesAdminTestsJSON-843699932 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7531204223633, 'free_capacity_gb': 1775.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86698) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 13:31:29 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e 1073741824" returned: 0 in 0.873s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:29 devstack sudo[101488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e
Jul 06 13:31:29 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8a675e7b-ba6b-41f8-b776-3efe420b72b9 tempest-BackendsCapabilitiesAdminTestsJSON-843699932 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7531204223633, 'free_capacity_gb': 1775.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86698) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 13:31:30 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e" returned: 0 in 0.710s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.988s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1924953660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4ae5cb-ad81-4a46-a952-10e8b74156bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a10823cd34f4c50b60f70c515817c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:23Z,use_quota=True,user_id='db57e438250744a4a70e9a1699a8e161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Creating volume dc4ae5cb-ad81-4a46-a952-10e8b74156bc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad83a13-0547-41eb-a4ab-b379702580ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199b9949-8c8d-4275-902a-58fac1ea6f8e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:30 devstack sudo[101491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc 1073741824
Jul 06 13:31:30 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc8656-f7b0-4da0-b7e7-87e25b10e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume volume-199b9949-8c8d-4275-902a-58fac1ea6f8e (199b9949-8c8d-4275-902a-58fac1ea6f8e): created successfully
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc8656-f7b0-4da0-b7e7-87e25b10e77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Flow 'volume_create_manager' (1fb8480e-652e-4144-aecd-9fab4c9ca5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-53363810-24b5-47cc-aabd-10d421468e7a tempest-TestServerVolumeAttachmentScenario-1853379470 None] Created volume successfully.
Jul 06 13:31:31 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc 1073741824" returned: 0 in 0.931s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:31 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc
Jul 06 13:31:31 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:32 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" returned: 0 in 0.787s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2838fe57-c18f-43d1-b005-ebed087ab50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeec7d6-3cee-4e3c-9843-7f13abed1f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Volume volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc (dc4ae5cb-ad81-4a46-a952-10e8b74156bc): created successfully
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeec7d6-3cee-4e3c-9843-7f13abed1f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Flow 'volume_create_manager' (a95b8d95-954f-4a24-9fe3-8b0f6851a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a7c23ed0-b92c-4a6e-8384-e24c03782b0e tempest-TestServerVolumeAttachmentScenario-1853379470 None] Created volume successfully.
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Flow 'volume_create_manager' (349a0661-a88b-406c-86f5-aeab3e4d2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25041177-1f0a-4d96-a784-ac4e119dd97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25041177-1f0a-4d96-a784-ac4e119dd97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-602849540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1435c58d-7b78-4c7f-864f-9c1f6ae7a023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a8942c81f4c688848f017a5346860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41620857-8c17-4128-bc91-05ff6b3baeaa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:40Z,use_quota=True,user_id='268d945f74ea409e9d6c1c166966def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f64c84-7c60-49a0-93f3-701419f25111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f64c84-7c60-49a0-93f3-701419f25111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a8be2-e1ba-41ca-a95d-090b3e75d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a5a8be2-e1ba-41ca-a95d-090b3e75d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1435c58d-7b78-4c7f-864f-9c1f6ae7a023', 'volume_name': 'volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023', 'volume_size': 1, 'snapshot_id': '41620857-8c17-4128-bc91-05ff6b3baeaa'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dde8c6-dcf9-4e8e-a563-adad8b6376a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dde8c6-dcf9-4e8e-a563-adad8b6376a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f702d08-e9f5-4c30-9dba-2ad3f5fd508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Volume 1435c58d-7b78-4c7f-864f-9c1f6ae7a023: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023', 'volume_size': 1, 'snapshot_id': '41620857-8c17-4128-bc91-05ff6b3baeaa'}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Creating volume 1435c58d-7b78-4c7f-864f-9c1f6ae7a023 from snapshot 41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] snapshot: 41620857-8c17-4128-bc91-05ff6b3baeaa, volume: 1435c58d-7b78-4c7f-864f-9c1f6ae7a023,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[13358f1b-73ce-4921-a2d5-0e2e036172f1]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:40 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:31:40 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:41 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 1.161s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d722dbd6-df6e-4f42-835e-c03cd90062da]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:41 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:31:41 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:42 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 1.103s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:42 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:31:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:42 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023
Jul 06 13:31:42 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Flow 'volume_create_manager' (2793e736-68d0-4fd3-889c-7c4e964ed6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82976c5c-5f78-4ba6-b595-66848233d02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82976c5c-5f78-4ba6-b595-66848233d02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-409788974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b44e2-104c-46e3-b729-d2870c0c5d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba477a71e894336ae85cacd531ce172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:47Z,use_quota=True,user_id='260442f5c3464bd48ed63c7cd2f20215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369db904-55bf-46ca-b1da-e08dcd5334b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (369db904-55bf-46ca-b1da-e08dcd5334b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dcc0b6-4516-4902-869d-e00fdd9ca3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75dcc0b6-4516-4902-869d-e00fdd9ca3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03b44e2-104c-46e3-b729-d2870c0c5d97', 'volume_name': 'volume-f03b44e2-104c-46e3-b729-d2870c0c5d97', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5770d80-519e-432e-bab7-f78f0e821241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5770d80-519e-432e-bab7-f78f0e821241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a848c65-98c3-4d24-b248-a8a1787a67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Volume f03b44e2-104c-46e3-b729-d2870c0c5d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03b44e2-104c-46e3-b729-d2870c0c5d97', 'volume_size': 1}
Jul 06 13:31:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:50 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" returned: 0 in 8.232s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0f0ef4-d40c-4c3c-8f2a-410930b944fc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:50 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:31:50 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:52 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 1.530s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:52 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:31:52 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Converted 1024.00 MB image at 124.33 MB/s
Jul 06 13:31:52 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 is being set with open permissions: ugo+rw
Jul 06 13:31:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:52 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023
Jul 06 13:31:52 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:52 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" returned: 0 in 0.901s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" released by "_copy_volume_from_snapshot" :: held 13.101s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" released by "_create_volume_from_snapshot" :: held 13.141s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.159s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.135s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-409788974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b44e2-104c-46e3-b729-d2870c0c5d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ba477a71e894336ae85cacd531ce172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:31:47Z,use_quota=True,user_id='260442f5c3464bd48ed63c7cd2f20215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Creating volume f03b44e2-104c-46e3-b729-d2870c0c5d97 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:31:53 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:53 devstack sudo[101683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 1073741824
Jul 06 13:31:53 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f702d08-e9f5-4c30-9dba-2ad3f5fd508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023', 'volume_size': 1, 'snapshot_id': '41620857-8c17-4128-bc91-05ff6b3baeaa'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c01ce25-9907-449c-8b9d-593c2606d10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Volume volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 (1435c58d-7b78-4c7f-864f-9c1f6ae7a023): created successfully
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c01ce25-9907-449c-8b9d-593c2606d10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Flow 'volume_create_manager' (349a0661-a88b-406c-86f5-aeab3e4d2af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d77fba68-2ba9-4c4c-ae02-3948d375402c tempest-TestStampPattern-341745948 None] Created volume successfully.
Jul 06 13:31:53 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 1073741824" returned: 0 in 0.893s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:53 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97
Jul 06 13:31:53 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:54 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97" returned: 0 in 0.645s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a848c65-98c3-4d24-b248-a8a1787a67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03b44e2-104c-46e3-b729-d2870c0c5d97', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56164a09-13b5-40d8-a4e7-6c4697e0c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:31:54 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Volume volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 (f03b44e2-104c-46e3-b729-d2870c0c5d97): created successfully
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56164a09-13b5-40d8-a4e7-6c4697e0c196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:31:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Flow 'volume_create_manager' (2793e736-68d0-4fd3-889c-7c4e964ed6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:31:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4393bc39-5d4b-4572-a2f4-dc819d49073b tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Created volume successfully.
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Acquiring lock "cinder-f03b44e2-104c-46e3-b729-d2870c0c5d97-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "cinder-f03b44e2-104c-46e3-b729-d2870c0c5d97-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Acquiring lock "cinder-quobyte-f03b44e2-104c-46e3-b729-d2870c0c5d97" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "cinder-quobyte-f03b44e2-104c-46e3-b729-d2870c0c5d97" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e792fe5-beee-4963-94c0-dd48da402b67]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:31:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:56 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97
Jul 06 13:31:56 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:57 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:57 devstack sudo[101745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97
Jul 06 13:31:57 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:58 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f03b44e2-104c-46e3-b729-d2870c0c5d97" returned: 0 in 0.678s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "cinder-quobyte-f03b44e2-104c-46e3-b729-d2870c0c5d97" released by "delete_volume" :: held 1.504s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Created reservations ['15c594ff-d8d4-450a-8f41-92b4cbb71a80', '267c93ce-2d93-47cb-9048-6b8be7b656ff', '3ae5cf52-bbf5-489f-8042-2180e8fd0b03', '3c85800a-5851-471d-b393-f70b8895bda4'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:31:58 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:31:58 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:31:58 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.756s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:31:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Deleted volume successfully.
Jul 06 13:31:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-212045af-2333-4a24-902f-f5e4ea0a03cd tempest-VolumeQuotasNegativeTestJSON-1616418677 None] Lock "cinder-f03b44e2-104c-46e3-b729-d2870c0c5d97-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Flow 'volume_create_manager' (bc215591-a45c-48c6-8069-b531196a14f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecd997-16b5-42eb-8cc7-82b40ef98c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecd997-16b5-42eb-8cc7-82b40ef98c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-536211018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987f973-5595-41c9-900c-0929dc08ace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24cd7106340f4a6e80f9aa553433a3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:06Z,use_quota=True,user_id='ba83b56991414e178ec3d4c813810c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3841cbc0-0497-4466-a512-d0b6312a99c8),volume_type_id=3841cbc0-0497-4466-a512-d0b6312a99c8)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb1f1a8-c2ba-4c32-b573-64a579136f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb1f1a8-c2ba-4c32-b573-64a579136f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0664d1ff-645c-4191-90f8-b3e923d224aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0664d1ff-645c-4191-90f8-b3e923d224aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd987f973-5595-41c9-900c-0929dc08ace7', 'volume_name': 'volume-d987f973-5595-41c9-900c-0929dc08ace7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c5bc86-cbc2-4f2f-bd97-cf214cdb84d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c5bc86-cbc2-4f2f-bd97-cf214cdb84d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad30455-4bd0-451a-bdd2-f0c63fd4d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Volume d987f973-5595-41c9-900c-0929dc08ace7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d987f973-5595-41c9-900c-0929dc08ace7', 'volume_size': 1}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-536211018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d987f973-5595-41c9-900c-0929dc08ace7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24cd7106340f4a6e80f9aa553433a3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:06Z,use_quota=True,user_id='ba83b56991414e178ec3d4c813810c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3841cbc0-0497-4466-a512-d0b6312a99c8),volume_type_id=3841cbc0-0497-4466-a512-d0b6312a99c8)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Creating volume d987f973-5595-41c9-900c-0929dc08ace7 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:06 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:06 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 1073741824
Jul 06 13:32:06 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:06 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 1073741824" returned: 0 in 0.877s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:07 devstack sudo[101804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7
Jul 06 13:32:07 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:07 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7" returned: 0 in 0.668s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=52,cinder:UPDATE=72,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad30455-4bd0-451a-bdd2-f0c63fd4d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d987f973-5595-41c9-900c-0929dc08ace7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6512fcff-9f0f-422d-a229-ce1bbba3471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=57,cinder:UPDATE=69,cinder:INSERT=10,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:32:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Volume volume-d987f973-5595-41c9-900c-0929dc08ace7 (d987f973-5595-41c9-900c-0929dc08ace7): created successfully
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6512fcff-9f0f-422d-a229-ce1bbba3471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Flow 'volume_create_manager' (bc215591-a45c-48c6-8069-b531196a14f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-358a79cf-78b7-4038-ae33-d35e16eea8ea tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Created volume successfully.
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:08 devstack sudo[101810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:08 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:09 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.641s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-26df4dbe-ead0-40f4-9991-20816b37cf21 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Retype volume completed successfully.
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "cinder-d987f973-5595-41c9-900c-0929dc08ace7-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "cinder-d987f973-5595-41c9-900c-0929dc08ace7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "cinder-quobyte-d987f973-5595-41c9-900c-0929dc08ace7" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "cinder-quobyte-d987f973-5595-41c9-900c-0929dc08ace7" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b7c12-d95e-436a-8e90-fc8a78246604]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:10 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7
Jul 06 13:32:10 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2070e1-eeec-4eda-8ee8-0f795943531a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:10 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7" returned: 0 in 0.852s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:10 devstack sudo[101860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e
Jul 06 13:32:10 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:10 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7
Jul 06 13:32:10 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:11 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e" returned: 0 in 0.838s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-199b9949-8c8d-4275-902a-58fac1ea6f8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4fd02d9-4567-4426-a7e8-00dc59ffa0bb', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:32:11 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d987f973-5595-41c9-900c-0929dc08ace7" returned: 0 in 0.787s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "cinder-quobyte-d987f973-5595-41c9-900c-0929dc08ace7" released by "delete_volume" :: held 1.690s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-cc7c1634-1781-4a41-bfd3-9096cd90fe66 req-d855492b-bd74-4fc0-b12e-280619828284 tempest-TestServerVolumeAttachmentScenario-1853379470 None] attachment_update completed successfully.
Jul 06 13:32:11 devstack cinder-volume[86698]: WARNING cinder.quota [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:32:11 devstack cinder-volume[86698]: WARNING cinder.quota [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Created reservations ['21f0106e-bbe3-4ab3-80a0-e1ed5a8d72fb', '8d5510e2-1246-40d7-9bbb-1f6a1f45f07d', '58b10093-5e1f-40de-86cc-b11751745ab5', '54c57c4a-0c3b-43b2-b05a-41e4f51d1ddb'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:11 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:11 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:12 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.711s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:12 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Deleted volume successfully.
Jul 06 13:32:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f59ec70e-be0f-418a-8839-9e5a058d1278 tempest-VolumeRetypeWithoutMigrationTest-665364158 None] Lock "cinder-d987f973-5595-41c9-900c-0929dc08ace7-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:18 devstack sudo[102269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:18 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:19 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.750s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:32:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:32:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:32:21 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=18,cinder:DELETE=1,cinder:SELECT=15,cinder:INSERT=3 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:32:22 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:32:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b65d1-ae01-457c-89c3-ec715776c9a9]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:22 devstack sudo[102283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc
Jul 06 13:32:22 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Flow 'volume_create_manager' (ac4a140a-8fad-47b6-bd99-808f7acc65ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecfa2b6-6533-4186-a409-5a1915763e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecfa2b6-6533-4186-a409-5a1915763e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1656378115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0cc885-a9f7-4e33-9033-d83dfa964b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005b2e4a246b43dda946f2542f263770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:23Z,use_quota=True,user_id='0d655c6493634b658b0324b4dc68b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ad1f580-7447-43ab-9f9b-53dfce81c401),volume_type_id=3ad1f580-7447-43ab-9f9b-53dfce81c401)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ec16ee-3aa2-44b0-9bb2-8d78f6383601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ec16ee-3aa2-44b0-9bb2-8d78f6383601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503725e2-ec6d-4c6d-9114-3dd87554e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503725e2-ec6d-4c6d-9114-3dd87554e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0cc885-a9f7-4e33-9033-d83dfa964b6d', 'volume_name': 'volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edcc8fa-0b11-4b1a-9742-e6a22e2d425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edcc8fa-0b11-4b1a-9742-e6a22e2d425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c238ed-f8a5-4a98-83bf-115711e565be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Volume fb0cc885-a9f7-4e33-9033-d83dfa964b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d', 'volume_size': 1}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:23 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" returned: 0 in 0.758s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1656378115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0cc885-a9f7-4e33-9033-d83dfa964b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005b2e4a246b43dda946f2542f263770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:23Z,use_quota=True,user_id='0d655c6493634b658b0324b4dc68b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ad1f580-7447-43ab-9f9b-53dfce81c401),volume_type_id=3ad1f580-7447-43ab-9f9b-53dfce81c401)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Creating volume fb0cc885-a9f7-4e33-9033-d83dfa964b6d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:23 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:23 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d 1073741824
Jul 06 13:32:23 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff4ce7d7-421f-45e8-9a6f-1660c4e8244b', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:32:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-d0d77db0-378d-4605-8062-c218606aa6a1 req-d361c55e-5c44-4525-9fdb-f8214a870c24 tempest-TestServerVolumeAttachmentScenario-1853379470 None] attachment_update completed successfully.
Jul 06 13:32:24 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d 1073741824" returned: 0 in 0.982s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:24 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d
Jul 06 13:32:24 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:25 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" returned: 0 in 0.659s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c238ed-f8a5-4a98-83bf-115711e565be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770a4d78-9ee2-434e-a797-8e7e3d1a5887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Volume volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d (fb0cc885-a9f7-4e33-9033-d83dfa964b6d): created successfully
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770a4d78-9ee2-434e-a797-8e7e3d1a5887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Flow 'volume_create_manager' (ac4a140a-8fad-47b6-bd99-808f7acc65ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9aed6844-e3d4-45ec-94fb-f7ad5ede0a35 tempest-VolumeTypesAccessTest-479366777 None] Created volume successfully.
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Acquiring lock "cinder-fb0cc885-a9f7-4e33-9033-d83dfa964b6d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "cinder-fb0cc885-a9f7-4e33-9033-d83dfa964b6d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Acquiring lock "cinder-quobyte-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "cinder-quobyte-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[61badf1d-c501-43b3-9b63-7d0d2d636db6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:25 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d
Jul 06 13:32:25 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:26 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" returned: 0 in 0.778s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:26 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d
Jul 06 13:32:26 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:26 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" returned: 0 in 0.668s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "cinder-quobyte-fb0cc885-a9f7-4e33-9033-d83dfa964b6d" released by "delete_volume" :: held 1.498s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:27 devstack cinder-volume[86698]: WARNING cinder.quota [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-577795292 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-577795292, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:32:27 devstack cinder-volume[86698]: WARNING cinder.quota [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-577795292 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-577795292, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Created reservations ['78cc6a7c-d7c0-4980-b252-a3cd573eaeae', '0f40ad69-eb31-4408-abd3-f22b17a4cde0', 'edd37de5-cf49-4267-bd41-e27a7c13e9ad', '8dfda195-8ed4-436e-87a8-11db7c7aa8de'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:27 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:27 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:27 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.697s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Deleted volume successfully.
Jul 06 13:32:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c50d096a-aad7-48e4-83f1-15c80cec87e7 tempest-VolumeTypesAccessTest-479366777 None] Lock "cinder-fb0cc885-a9f7-4e33-9033-d83dfa964b6d-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-268c7b15-8a66-4357-8dbb-9f4373e2ee12 req-23e46b8e-1fc1-4523-b040-170bc33ad0aa tempest-TestServerVolumeAttachmentScenario-1853379470 None] Terminate volume connection completed successfully.
Jul 06 13:32:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-268c7b15-8a66-4357-8dbb-9f4373e2ee12 req-23e46b8e-1fc1-4523-b040-170bc33ad0aa tempest-TestServerVolumeAttachmentScenario-1853379470 None] Deleting attachment ff4ce7d7-421f-45e8-9a6f-1660c4e8244b. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:32:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:30 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c421fd-15fd-40b6-b662-5bc6408c0603]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:30 devstack sudo[102330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023
Jul 06 13:32:30 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:31 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" returned: 0 in 0.876s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.899s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794', 'name': 'volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b728024a-85cd-4684-8881-4be79cf89430', 'enforce_multipath': True} {{(pid=86698) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 13:32:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-d818b24c-c82e-450b-858c-3b081f792745 req-cd7cb8f8-f0c1-46b7-ae6e-4a48f0f88d41 tempest-TestStampPattern-341745948 None] attachment_update completed successfully.
Jul 06 13:32:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-05858649-8dfc-4768-a6c2-95301615db0b req-e9643c95-2f19-492d-961a-2628ac36469c tempest-TestServerVolumeAttachmentScenario-1853379470 None] Terminate volume connection completed successfully.
Jul 06 13:32:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-05858649-8dfc-4768-a6c2-95301615db0b req-e9643c95-2f19-492d-961a-2628ac36469c tempest-TestServerVolumeAttachmentScenario-1853379470 None] Deleting attachment e4fd02d9-4567-4426-a7e8-00dc59ffa0bb. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:32:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [req-861a263d-4583-41b1-811e-93793c1c5d63 req-4089ef7b-63e9-4b71-a615-d1563493f7bd tempest-TestStampPattern-341745948 None] Terminate volume connection completed successfully.
Jul 06 13:32:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [req-861a263d-4583-41b1-811e-93793c1c5d63 req-4089ef7b-63e9-4b71-a615-d1563493f7bd tempest-TestStampPattern-341745948 None] Deleting attachment b728024a-85cd-4684-8881-4be79cf89430. {{(pid=86698) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (5d6b4015-091a-4126-b0ba-fa04080abc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6d7c9-a8da-4070-b5ad-191d5a44c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6d7c9-a8da-4070-b5ad-191d5a44c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1792652884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264fe90d-94b9-4563-91a1-c48c4fdd062d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:41Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14558f06-103e-42aa-8ddf-50ea3e1c1187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14558f06-103e-42aa-8ddf-50ea3e1c1187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc4af9c-2b45-494b-a142-bc17ca2aafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adc4af9c-2b45-494b-a142-bc17ca2aafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '264fe90d-94b9-4563-91a1-c48c4fdd062d', 'volume_name': 'volume-264fe90d-94b9-4563-91a1-c48c4fdd062d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d45fa7-da0d-4b29-8e7b-341cd69ca71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d45fa7-da0d-4b29-8e7b-341cd69ca71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8101a417-4ab2-4b1c-bc0d-32e29bf834db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:41 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Volume 264fe90d-94b9-4563-91a1-c48c4fdd062d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-264fe90d-94b9-4563-91a1-c48c4fdd062d', 'volume_size': 1}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1792652884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=264fe90d-94b9-4563-91a1-c48c4fdd062d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:41Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Creating volume 264fe90d-94b9-4563-91a1-c48c4fdd062d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:41 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:41 devstack sudo[102410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d 1073741824
Jul 06 13:32:41 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:42 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d 1073741824" returned: 0 in 0.959s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:42 devstack sudo[102421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d
Jul 06 13:32:42 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:42 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d" returned: 0 in 0.766s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8101a417-4ab2-4b1c-bc0d-32e29bf834db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-264fe90d-94b9-4563-91a1-c48c4fdd062d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6cb15f-5a43-4ab4-9c75-2b7e6dcba503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Volume volume-264fe90d-94b9-4563-91a1-c48c4fdd062d (264fe90d-94b9-4563-91a1-c48c4fdd062d): created successfully
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6cb15f-5a43-4ab4-9c75-2b7e6dcba503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (5d6b4015-091a-4126-b0ba-fa04080abc55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-70a4e9f4-1426-4e48-8eda-212f9290e07e tempest-VolumesListAdminTestJSON-521189615 None] Created volume successfully.
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (edf45c12-a1a3-425c-84f5-f2178cd4da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4229f9b-0470-4072-9505-b19428684bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4229f9b-0470-4072-9505-b19428684bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-555170633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29486920-a976-4e17-be0f-8cc5d7de6cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:44Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e51eb-5f36-4b00-aa45-d37098a9a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e51eb-5f36-4b00-aa45-d37098a9a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bafdf4-a920-45e7-9270-33210797f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bafdf4-a920-45e7-9270-33210797f795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29486920-a976-4e17-be0f-8cc5d7de6cb4', 'volume_name': 'volume-29486920-a976-4e17-be0f-8cc5d7de6cb4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463058ca-27ff-4695-b4b1-c0345f7b095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463058ca-27ff-4695-b4b1-c0345f7b095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9817c038-9c97-461d-bc0d-be3e659b1fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:43 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Volume 29486920-a976-4e17-be0f-8cc5d7de6cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29486920-a976-4e17-be0f-8cc5d7de6cb4', 'volume_size': 1}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-555170633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29486920-a976-4e17-be0f-8cc5d7de6cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:44Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Creating volume 29486920-a976-4e17-be0f-8cc5d7de6cb4 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:43 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:43 devstack sudo[102446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 1073741824
Jul 06 13:32:43 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "cinder-dc4ae5cb-ad81-4a46-a952-10e8b74156bc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-dc4ae5cb-ad81-4a46-a952-10e8b74156bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "cinder-quobyte-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-quobyte-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0471ea27-3578-46c0-a80e-d21c71ad9c58]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:44 devstack sudo[102448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc
Jul 06 13:32:44 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:44 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 1073741824" returned: 0 in 0.945s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:44 devstack sudo[102453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4
Jul 06 13:32:44 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:45 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" returned: 0 in 0.806s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:45 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc
Jul 06 13:32:45 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:45 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4" returned: 0 in 0.643s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9817c038-9c97-461d-bc0d-be3e659b1fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29486920-a976-4e17-be0f-8cc5d7de6cb4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d606ad56-cd42-4211-8a57-081416dc9e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:45 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Volume volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 (29486920-a976-4e17-be0f-8cc5d7de6cb4): created successfully
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d606ad56-cd42-4211-8a57-081416dc9e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (edf45c12-a1a3-425c-84f5-f2178cd4da53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f5e69b76-5649-4fcb-9cff-7d220dd7c815 tempest-VolumesListAdminTestJSON-521189615 None] Created volume successfully.
Jul 06 13:32:45 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" returned: 0 in 0.693s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-quobyte-dc4ae5cb-ad81-4a46-a952-10e8b74156bc" released by "delete_volume" :: held 1.545s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Created reservations ['2a435c06-8080-477d-8264-0a4eb976c0bf', 'a9fded2b-e724-4fd0-866f-a2af6fe3fba7', '553cb0a1-2b38-4143-89c7-5bfde940b9ce', 'e8bdbf7a-fe64-4d6b-8a2d-3ccce9915b8f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:45 devstack sudo[102462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:45 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "cinder-199b9949-8c8d-4275-902a-58fac1ea6f8e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-199b9949-8c8d-4275-902a-58fac1ea6f8e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (7b593dd9-54ee-47a6-869b-9d82803fbaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8631c703-c0af-48dd-9567-2dc8cdeb87be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8631c703-c0af-48dd-9567-2dc8cdeb87be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1629801599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedad40a-be45-43ec-aa48-2a773f5bc0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:46Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0b53fe-22fe-47c7-a134-6246a032876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0b53fe-22fe-47c7-a134-6246a032876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b500d043-1ecd-46f1-b581-afa747e2ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b500d043-1ecd-46f1-b581-afa747e2ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dedad40a-be45-43ec-aa48-2a773f5bc0ec', 'volume_name': 'volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a890830-9e5e-4a98-8133-9b82b85eaa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a890830-9e5e-4a98-8133-9b82b85eaa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11563743-0adb-49a9-97e6-38015cc96c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Volume dedad40a-be45-43ec-aa48-2a773f5bc0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec', 'volume_size': 1}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1629801599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dedad40a-be45-43ec-aa48-2a773f5bc0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf26e38e0d74ce3972e562dd81169be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:46Z,use_quota=True,user_id='04c6f4f69a454345abd392c725382179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Creating volume dedad40a-be45-43ec-aa48-2a773f5bc0ec {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:46 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "cinder-quobyte-199b9949-8c8d-4275-902a-58fac1ea6f8e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:46 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec 1073741824
Jul 06 13:32:46 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:46 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.711s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Deleted volume successfully.
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-quobyte-199b9949-8c8d-4275-902a-58fac1ea6f8e" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7f592552-308b-4406-a8c0-8d68bbaaeeaf tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-dc4ae5cb-ad81-4a46-a952-10e8b74156bc-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32146e0-e8b1-4cdd-a2e9-b9a68a6da11a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:46 devstack sudo[102467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e
Jul 06 13:32:46 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-1435c58d-7b78-4c7f-864f-9c1f6ae7a023-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "cinder-1435c58d-7b78-4c7f-864f-9c1f6ae7a023-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a05f4-637a-4bdd-942c-d9d11c686186]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:47 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023
Jul 06 13:32:47 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:47 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec 1073741824" returned: 0 in 0.949s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:47 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e" returned: 0 in 0.940s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:47 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec
Jul 06 13:32:47 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:47 devstack sudo[102481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e
Jul 06 13:32:47 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:48 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" returned: 0 in 0.845s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:48 devstack sudo[102486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023
Jul 06 13:32:48 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:48 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec" returned: 0 in 0.701s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11563743-0adb-49a9-97e6-38015cc96c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aaed69-a508-4d04-baa9-99322c318d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Volume volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec (dedad40a-be45-43ec-aa48-2a773f5bc0ec): created successfully
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9aaed69-a508-4d04-baa9-99322c318d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Flow 'volume_create_manager' (7b593dd9-54ee-47a6-869b-9d82803fbaa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-13e23dea-49f8-4823-8f35-109dd09028aa tempest-VolumesListAdminTestJSON-521189615 None] Created volume successfully.
Jul 06 13:32:48 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-199b9949-8c8d-4275-902a-58fac1ea6f8e" returned: 0 in 0.807s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-quobyte-199b9949-8c8d-4275-902a-58fac1ea6f8e" released by "delete_volume" :: held 1.801s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Created reservations ['e21fa820-a01f-4722-ad86-56daac80748e', '48a009f1-abe7-4c0c-8885-24cbb3e0f912', '3e4fd3b2-c4cd-4122-887a-fbbf19ed1421', 'e272a59b-89fb-4393-b97c-d1f7c7fdcb7f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:48 devstack sudo[102490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:48 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:48 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" returned: 0 in 0.749s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-1435c58d-7b78-4c7f-864f-9c1f6ae7a023" released by "delete_volume" :: held 1.647s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Created reservations ['939c5b20-dd82-4613-9d1f-f8f036bf4546', '669f2e21-cc97-45b6-9d05-f5af0e9ae5c4', 'b8fe82c7-4020-49cc-b54f-038f2c75c0be', 'f01c8740-9431-41d6-866f-d216b0025f40'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:49 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:49 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Flow 'volume_create_manager' (59cf598c-9cb4-4677-9dc8-405e0c2aad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6226be-5824-46ff-bd51-6b759155b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6226be-5824-46ff-bd51-6b759155b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2033fcfd-a3d2-4918-98e4-855c74b66ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f754ddda4e7a4aabb412848473411468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:49Z,use_quota=True,user_id='34e2901482ad4ce4b9f64c2210e2985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed270aad-7304-4884-b5ee-46a20771ae95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed270aad-7304-4884-b5ee-46a20771ae95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe19e6d-a3ee-4c28-9765-3afb945f16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fe19e6d-a3ee-4c28-9765-3afb945f16cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2033fcfd-a3d2-4918-98e4-855c74b66ad6', 'volume_name': 'volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e9887-9bc8-47d5-80b9-9a643ce14ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e9887-9bc8-47d5-80b9-9a643ce14ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fa7365-7791-4507-9ee3-b97421775aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:49 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Volume 2033fcfd-a3d2-4918-98e4-855c74b66ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6', 'volume_size': 1}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2033fcfd-a3d2-4918-98e4-855c74b66ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f754ddda4e7a4aabb412848473411468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:32:49Z,use_quota=True,user_id='34e2901482ad4ce4b9f64c2210e2985c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Creating volume 2033fcfd-a3d2-4918-98e4-855c74b66ad6 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:32:49 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:49 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 1073741824
Jul 06 13:32:49 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:49 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.125s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Deleted volume successfully.
Jul 06 13:32:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13e26041-9be5-4532-852b-80a17e4fae38 tempest-TestServerVolumeAttachmentScenario-1853379470 None] Lock "cinder-199b9949-8c8d-4275-902a-58fac1ea6f8e-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-41620857-8c17-4128-bc91-05ff6b3baeaa-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:50 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-41620857-8c17-4128-bc91-05ff6b3baeaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.008s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Deleted volume successfully.
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34e322bf-4c8f-4b8f-acd4-e328ad6f8fa0 tempest-TestStampPattern-341745948 None] Lock "cinder-1435c58d-7b78-4c7f-864f-9c1f6ae7a023-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Deleting offline snapshot 41620857-8c17-4128-bc91-05ff6b3baeaa of volume e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] snapshot_file for this snap is: volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[96edcd23-4b6a-4e18-9513-876fa3e86493]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:50 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:32:50 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:50 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 1073741824" returned: 0 in 1.165s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:50 devstack sudo[102506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6
Jul 06 13:32:50 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:51 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 0.944s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e42a0b8-ae3e-41b6-9a56-ccbd4709f306]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:51 devstack sudo[102511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:32:51 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:51 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fa7365-7791-4507-9ee3-b97421775aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1c0f49-4f7d-4c44-aee4-c8b52eac30d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:32:51 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Volume volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 (2033fcfd-a3d2-4918-98e4-855c74b66ad6): created successfully
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1c0f49-4f7d-4c44-aee4-c8b52eac30d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:32:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Flow 'volume_create_manager' (59cf598c-9cb4-4677-9dc8-405e0c2aad31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:32:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-01ce0f76-7b84-4dc0-9e84-325786167d6e tempest-VolumesListAdminTestJSON-1175898083 None] Created volume successfully.
Jul 06 13:32:52 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 0.861s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:52 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:32:52 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Acquiring lock "cinder-2033fcfd-a3d2-4918-98e4-855c74b66ad6-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "cinder-2033fcfd-a3d2-4918-98e4-855c74b66ad6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Acquiring lock "cinder-quobyte-2033fcfd-a3d2-4918-98e4-855c74b66ad6" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "cinder-quobyte-2033fcfd-a3d2-4918-98e4-855c74b66ad6" acquired by "delete_volume" :: waited 0.040s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f98a0-e987-4b8b-84de-3c0d721ee08f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:52 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 0.884s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:52 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa
Jul 06 13:32:52 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-dedad40a-be45-43ec-aa48-2a773f5bc0ec-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:52 devstack sudo[102523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6
Jul 06 13:32:52 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-dedad40a-be45-43ec-aa48-2a773f5bc0ec-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-quobyte-dedad40a-be45-43ec-aa48-2a773f5bc0ec" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-dedad40a-be45-43ec-aa48-2a773f5bc0ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[75451881-8fdf-4034-bb24-7c06d8264dc0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:53 devstack sudo[102528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec
Jul 06 13:32:53 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:53 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1.41620857-8c17-4128-bc91-05ff6b3baeaa" returned: 0 in 0.931s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:53 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6" returned: 0 in 1.072s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-41620857-8c17-4128-bc91-05ff6b3baeaa" released by "_delete_snapshot" :: held 3.747s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" released by "delete_snapshot" :: held 3.785s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:53 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6
Jul 06 13:32:53 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:53 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Created reservations ['87afba5d-5bc3-4a71-bec8-5f0c7d33cfe9', '10d662b8-85bc-4b33-9130-138ca0e04a78', '7e965a66-b58e-4692-895d-2e65dea7c7cf', 'a3b98175-f8b3-49c3-a805-6df0151671ca'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Delete snapshot completed successfully.
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4ae15b0a-7553-45d3-abb6-4cfa298d1fe9 tempest-TestStampPattern-341745948 None] Lock "cinder-41620857-8c17-4128-bc91-05ff6b3baeaa-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:54 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec" returned: 0 in 1.099s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:54 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec
Jul 06 13:32:54 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:54 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2033fcfd-a3d2-4918-98e4-855c74b66ad6" returned: 0 in 0.829s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "cinder-quobyte-2033fcfd-a3d2-4918-98e4-855c74b66ad6" released by "delete_volume" :: held 1.959s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Created reservations ['b5e224d5-8ba1-41ea-bb57-93b7538bffd7', '76dd77a2-2c9c-44c6-a1c1-d17f73c63232', '0db2a765-1015-48fe-a626-b0e610bd4742', '2044520e-33f1-446d-aa00-eb0a15ba8599'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:54 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:54 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:55 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dedad40a-be45-43ec-aa48-2a773f5bc0ec" returned: 0 in 0.840s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-dedad40a-be45-43ec-aa48-2a773f5bc0ec" released by "delete_volume" :: held 1.995s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Created reservations ['a5c3f767-1aa8-4140-809d-25eb2c3c2699', '23be763c-fee3-4a7b-9e6d-d7529c024729', '048e373f-74a6-407b-9abb-26f57039f77a', '8b35f6dc-1163-49e7-be5d-8d209030d092'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:55 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:55 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:55 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.957s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Deleted volume successfully.
Jul 06 13:32:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f1b35c62-054d-4603-845f-c0b34949c95f tempest-VolumesListAdminTestJSON-1175898083 None] Lock "cinder-2033fcfd-a3d2-4918-98e4-855c74b66ad6-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:56 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.898s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Deleted volume successfully.
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fc7b6a4b-abe1-4f37-ba4d-19d9df236f33 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-dedad40a-be45-43ec-aa48-2a773f5bc0ec-delete_volume" released by "delete_volume" :: held 3.240s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-29486920-a976-4e17-be0f-8cc5d7de6cb4-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-29486920-a976-4e17-be0f-8cc5d7de6cb4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-quobyte-29486920-a976-4e17-be0f-8cc5d7de6cb4" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-29486920-a976-4e17-be0f-8cc5d7de6cb4" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c1a45c-c4d5-4535-866b-8119beb399fe]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:32:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:56 devstack sudo[102553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4
Jul 06 13:32:56 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:57 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4" returned: 0 in 1.094s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:57 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4
Jul 06 13:32:57 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:58 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-29486920-a976-4e17-be0f-8cc5d7de6cb4" returned: 0 in 0.836s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-29486920-a976-4e17-be0f-8cc5d7de6cb4" released by "delete_volume" :: held 1.986s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Created reservations ['81ca271d-ec34-4417-9062-c9f5f81bb0c7', 'b0858d80-391a-4f43-b71b-7e9165b9878a', 'bdbb5f1f-6115-4cea-a7e2-2046addb4038', '6f5692e6-6fb6-4545-86f5-f8056900818f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:32:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:32:58 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:32:58 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:32:59 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Jul 06 13:32:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.764s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:32:59 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:32:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Deleted volume successfully.
Jul 06 13:32:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-261cfd0b-8942-453f-afb3-6d75d7b7b44c tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-29486920-a976-4e17-be0f-8cc5d7de6cb4-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:32:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-264fe90d-94b9-4563-91a1-c48c4fdd062d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:32:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-264fe90d-94b9-4563-91a1-c48c4fdd062d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "cinder-quobyte-264fe90d-94b9-4563-91a1-c48c4fdd062d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-264fe90d-94b9-4563-91a1-c48c4fdd062d" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf297a54-5362-4fa1-bff5-39b3afdd056a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:00 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d
Jul 06 13:33:00 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:00 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d" returned: 0 in 0.905s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:00 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d
Jul 06 13:33:00 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:01 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-264fe90d-94b9-4563-91a1-c48c4fdd062d" returned: 0 in 0.737s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-quobyte-264fe90d-94b9-4563-91a1-c48c4fdd062d" released by "delete_volume" :: held 1.694s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Created reservations ['c7dd3bc3-9b19-431d-8d49-4baa1a1f710c', 'ee418265-1b97-4e70-8483-4446b5f177b2', 'a694d157-f116-4d69-a694-f0640bde76c6', '2135c0db-41c5-4aaf-80ad-e312bb9b4e9c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:01 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:01 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-e7d47fd2-d4ce-404f-871d-e2855f35aab1-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "cinder-e7d47fd2-d4ce-404f-871d-e2855f35aab1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Acquiring lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdf741c-684e-4119-8c10-3dbcee4558cb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:02 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:33:02 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:02 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.903s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Deleted volume successfully.
Jul 06 13:33:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0116d0a3-5b69-43d6-942b-baf05e848451 tempest-VolumesListAdminTestJSON-521189615 None] Lock "cinder-264fe90d-94b9-4563-91a1-c48c4fdd062d-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:03 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 0.914s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:03 devstack sudo[102608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1
Jul 06 13:33:03 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:04 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e7d47fd2-d4ce-404f-871d-e2855f35aab1" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "cinder-quobyte-e7d47fd2-d4ce-404f-871d-e2855f35aab1" released by "delete_volume" :: held 1.755s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Created reservations ['b3981356-2414-4304-90dd-0feb427851bb', '64ab4f26-bd27-458f-bbab-8a62fda53b07', '8a49a415-ee5b-47a1-bd0c-5a35316316c1', '04dc78d2-b875-4254-af18-a62d43dd89d8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:04 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:04 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:05 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.882s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:05 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Deleted volume successfully.
Jul 06 13:33:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-564e7505-0252-4158-940f-cea459349d75 tempest-TestStampPattern-341745948 None] Lock "cinder-e7d47fd2-d4ce-404f-871d-e2855f35aab1-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Flow 'volume_create_manager' (a0baed3c-ba9d-42a9-aa90-14d214a6bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b780a1a-ab1c-4853-be52-6fcf6c3a7d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b780a1a-ab1c-4853-be52-6fcf6c3a7d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2add293b-ba2f-462c-a0dc-1ecfe3b1a46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f247d941b7c4fb2b8715646e5e49b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:09Z,use_quota=True,user_id='db15be91cb8d476abc7971a6b6177c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab0a688a-c5e1-4c72-9ab4-49207b4c07f1),volume_type_id=ab0a688a-c5e1-4c72-9ab4-49207b4c07f1)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601cacd2-067f-4294-bfc5-bcbf01fd791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (601cacd2-067f-4294-bfc5-bcbf01fd791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13aa960-6cf0-40fd-89ec-9f3f84807e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Flow 'volume_create_manager' (319192dd-58f7-4edc-b2bb-0055221e1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d79987-e618-4611-873a-1d37258a2f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d79987-e618-4611-873a-1d37258a2f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2026960306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc6f72-0314-4444-bd55-007ef9efa5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ff70c6a55241f68711887f12642e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:09Z,use_quota=True,user_id='8a66086c94d34bdd85cb471282847296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baca1ef-9345-40d1-88d7-5fc137503b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baca1ef-9345-40d1-88d7-5fc137503b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1b86fe-d046-4dc3-9504-a042f9f6e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13aa960-6cf0-40fd-89ec-9f3f84807e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2add293b-ba2f-462c-a0dc-1ecfe3b1a46c', 'volume_name': 'volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c', 'volume_size': 1, 'image_id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afe878041f6596ce696d36febfdfe10c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f247d941b7c4fb2b8715646e5e49b38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb3ef22c6d9328a541f31d5a0bdec60ab135e89ee345320432a404528a08a55351277065496bb4a1675eb7e7f4761adeca32cbea6cc8c333d075557cdafb3902', 'id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'created_at': datetime.datetime(2026, 7, 6, 11, 33, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 33, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/379a48ae-b2b2-47ac-abda-6414b58677bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359917e5a0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0bc38f-3670-4b6d-9f4d-e646845efa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0bc38f-3670-4b6d-9f4d-e646845efa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a7ca6a-584c-4731-8e0d-3578120efe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c', 'volume_size': 1, 'image_id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afe878041f6596ce696d36febfdfe10c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f247d941b7c4fb2b8715646e5e49b38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb3ef22c6d9328a541f31d5a0bdec60ab135e89ee345320432a404528a08a55351277065496bb4a1675eb7e7f4761adeca32cbea6cc8c333d075557cdafb3902', 'id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'created_at': datetime.datetime(2026, 7, 6, 11, 33, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 33, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/379a48ae-b2b2-47ac-abda-6414b58677bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359917e5a0>}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Trying to clone 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c from image 379a48ae-b2b2-47ac-abda-6414b58677bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d1b86fe-d046-4dc3-9504-a042f9f6e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34dc6f72-0314-4444-bd55-007ef9efa5fe', 'volume_name': 'volume-34dc6f72-0314-4444-bd55-007ef9efa5fe', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235992c3950>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a6af07-5961-4856-a24c-8260694fceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a6af07-5961-4856-a24c-8260694fceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce50618c-0c60-43c2-8e2d-c45379b81d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Volume 34dc6f72-0314-4444-bd55-007ef9efa5fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34dc6f72-0314-4444-bd55-007ef9efa5fe', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235992c3950>}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Trying to clone 34dc6f72-0314-4444-bd55-007ef9efa5fe from image 5accfc22-7cac-4370-846d-07a9c8ee1607 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:33:09 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6163072-f926-4883-9e6f-cfd6e7984507]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:09 devstack sudo[102617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:09 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:33:09 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c53a740-dab9-46ae-8fc3-76923e36a47d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:10 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD
Jul 06 13:33:10 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:10 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:10 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:10 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:10 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 is fetched for user 8a66086c94d34bdd85cb471282847296. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57bd43-e07d-43ba-a7d4-739a52886bb4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:11 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD
Jul 06 13:33:11 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:11 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 1 in 0.911s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Temporary image 379a48ae-b2b2-47ac-abda-6414b58677bd is fetched for user db15be91cb8d476abc7971a6b6177c12. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e132a-cd09-429d-82f8-3cdaadf56c26]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:11 devstack sudo[102671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:11 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:11 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2026960306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34dc6f72-0314-4444-bd55-007ef9efa5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ff70c6a55241f68711887f12642e87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:09Z,use_quota=True,user_id='8a66086c94d34bdd85cb471282847296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Creating volume 34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:11 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:11 devstack sudo[102676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1073741824
Jul 06 13:33:11 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:12 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:12 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:12 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:12 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1073741824" returned: 0 in 0.979s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:12 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:12 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:12 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:13 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 0 in 0.818s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2add293b-ba2f-462c-a0dc-1ecfe3b1a46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f247d941b7c4fb2b8715646e5e49b38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:09Z,use_quota=True,user_id='db15be91cb8d476abc7971a6b6177c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab0a688a-c5e1-4c72-9ab4-49207b4c07f1),volume_type_id=ab0a688a-c5e1-4c72-9ab4-49207b4c07f1)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Creating volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:13 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:13 devstack sudo[102694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1073741824
Jul 06 13:33:13 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Attempting download of 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 34dc6f72-0314-4444-bd55-007ef9efa5fe. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d316634-c84c-43fd-a6d1-6cf3d75be762]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:13 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7
Jul 06 13:33:13 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:14 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7" returned: 0 in 0.819s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:14 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1073741824" returned: 0 in 1.040s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:14 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7
Jul 06 13:33:14 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:14 devstack sudo[102707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:14 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:15 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7" returned: 1 in 0.870s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5accfc22-7cac-4370-846d-07a9c8ee1607_tqm0xjt7' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba5542-77d3-4ee4-b3f7-0257d65e040b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:15 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 0 in 0.739s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Attempting download of 379a48ae-b2b2-47ac-abda-6414b58677bd ((None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}])) to volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2092c-1753-4e79-98bb-0b060fa24134]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:15 devstack sudo[102712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD
Jul 06 13:33:15 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:15 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk
Jul 06 13:33:15 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:16 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:16 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] 5accfc22-7cac-4370-846d-07a9c8ee1607 was qcow2, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:33:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:16 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:16 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:16 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:16 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk
Jul 06 13:33:16 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:17 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk" returned: 1 in 0.753s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_379a48ae-b2b2-47ac-abda-6414b58677bd_z32a8tmk' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17c249d-b7fb-4793-b001-776256cbd01c]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:17 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:17 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:17 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:17 devstack sudo[102737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD
Jul 06 13:33:17 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (a782d1a7-7985-4350-94aa-e67aa5619c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f61d2a4-d852-4c7e-8f8a-882a5ad6f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f61d2a4-d852-4c7e-8f8a-882a5ad6f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1086880464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f21292-f482-408a-9784-7b6ec65d0f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:18Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f321d05-3746-4f9f-9c39-ebf95865a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f321d05-3746-4f9f-9c39-ebf95865a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b39018-ce6d-44ad-beae-c9edf1bf4514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b39018-ce6d-44ad-beae-c9edf1bf4514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71f21292-f482-408a-9784-7b6ec65d0f4d', 'volume_name': 'volume-71f21292-f482-408a-9784-7b6ec65d0f4d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db202ebb-0cf4-49e3-8aac-57f573ddd97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db202ebb-0cf4-49e3-8aac-57f573ddd97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e078b5-763f-494a-bb9c-47c63a7beca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume 71f21292-f482-408a-9784-7b6ec65d0f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71f21292-f482-408a-9784-7b6ec65d0f4d', 'volume_size': 1}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1086880464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71f21292-f482-408a-9784-7b6ec65d0f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:18Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume 71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:18 devstack sudo[102745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d 1073741824
Jul 06 13:33:18 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:18 devstack sudo[102746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:18 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:18 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 0 in 2.254s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5accfc22-7cac-4370-846d-07a9c8ee1607_3uunuyhedevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:33:18 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Converted 112.00 MB image at 49.66 MB/s
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:18 devstack sudo[102749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1G
Jul 06 13:33:18 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:18 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] 379a48ae-b2b2-47ac-abda-6414b58677bd was raw, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:33:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:18 devstack sudo[102754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:18 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:19 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:33:19 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe 1G" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a98078-631f-4a20-8fbb-977b438c9b56]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:19 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:19 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 0 in 0.759s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d 1073741824" returned: 0 in 1.008s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_379a48ae-b2b2-47ac-abda-6414b58677bd_s_vbjy4hdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:33:19 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:19 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:19 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1G
Jul 06 13:33:19 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:19 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:19 devstack sudo[102771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d
Jul 06 13:33:19 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:20 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 0 in 0.814s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:20 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c 1G" returned: 0 in 0.736s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:20 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d" returned: 0 in 0.712s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[16897a1d-fde2-4372-a059-a0a8c0f6b8a9]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e078b5-763f-494a-bb9c-47c63a7beca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71f21292-f482-408a-9784-7b6ec65d0f4d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daba1e9e-a1bc-42e3-969b-20a766151d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-71f21292-f482-408a-9784-7b6ec65d0f4d (71f21292-f482-408a-9784-7b6ec65d0f4d): created successfully
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daba1e9e-a1bc-42e3-969b-20a766151d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (a782d1a7-7985-4350-94aa-e67aa5619c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:20 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:20 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5b1fa491-29b9-434f-9f89-a2930799a8f6 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:20 devstack sudo[102780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:20 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating offline snapshot 479d7daf-5459-4d6e-9f73-f4d98491239c of volume 71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cee4c8-d194-4a69-bc71-cdfd58d0a470]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:20 devstack sudo[102783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d
Jul 06 13:33:20 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:20 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 1 in 0.808s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Downloaded image 5accfc22-7cac-4370-846d-07a9c8ee1607 ((None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}])) to volume 34dc6f72-0314-4444-bd55-007ef9efa5fe successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Temporary image 5accfc22-7cac-4370-846d-07a9c8ee1607 for user 8a66086c94d34bdd85cb471282847296 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:33:20 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Marking volume 34dc6f72-0314-4444-bd55-007ef9efa5fe as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Copying metadata from image 5accfc22-7cac-4370-846d-07a9c8ee1607 to 34dc6f72-0314-4444-bd55-007ef9efa5fe. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Creating volume glance metadata for volume 34dc6f72-0314-4444-bd55-007ef9efa5fe backed by image 5accfc22-7cac-4370-846d-07a9c8ee1607 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:33:21 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 0 in 0.857s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce50618c-0c60-43c2-8e2d-c45379b81d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34dc6f72-0314-4444-bd55-007ef9efa5fe', 'volume_size': 1, 'image_id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5accfc22-7cac-4370-846d-07a9c8ee1607', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4723e7dc01a547f4883217d75709b48a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5accfc22-7cac-4370-846d-07a9c8ee1607', 'created_at': datetime.datetime(2026, 7, 6, 11, 10, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 10, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5accfc22-7cac-4370-846d-07a9c8ee1607/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7235992c3950>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70186a7d-be5b-4296-8335-82e07a352d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Volume volume-34dc6f72-0314-4444-bd55-007ef9efa5fe (34dc6f72-0314-4444-bd55-007ef9efa5fe): created successfully
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70186a7d-be5b-4296-8335-82e07a352d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Flow 'volume_create_manager' (319192dd-58f7-4edc-b2bb-0055221e1767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0664b76f-46e7-4c1f-b931-a419fe5c6ff8 tempest-VolumesImageMetadata-2127684647 None] Created volume successfully.
Jul 06 13:33:21 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:21 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:21 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d" returned: 0 in 0.768s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:21 devstack sudo[102795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c 1G
Jul 06 13:33:21 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:21 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 1 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Downloaded image 379a48ae-b2b2-47ac-abda-6414b58677bd ((None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}])) to volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Temporary image 379a48ae-b2b2-47ac-abda-6414b58677bd for user db15be91cb8d476abc7971a6b6177c12 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Marking volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=96,cinder:UPDATE=97,cinder:DELETE=11,cinder:INSERT=30 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Copying metadata from image 379a48ae-b2b2-47ac-abda-6414b58677bd to 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Creating volume glance metadata for volume 2add293b-ba2f-462c-a0dc-1ecfe3b1a46c backed by image 379a48ae-b2b2-47ac-abda-6414b58677bd with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'afe878041f6596ce696d36febfdfe10c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a7ca6a-584c-4731-8e0d-3578120efe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c', 'volume_size': 1, 'image_id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/379a48ae-b2b2-47ac-abda-6414b58677bd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'afe878041f6596ce696d36febfdfe10c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9f247d941b7c4fb2b8715646e5e49b38', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cb3ef22c6d9328a541f31d5a0bdec60ab135e89ee345320432a404528a08a55351277065496bb4a1675eb7e7f4761adeca32cbea6cc8c333d075557cdafb3902', 'id': '379a48ae-b2b2-47ac-abda-6414b58677bd', 'created_at': datetime.datetime(2026, 7, 6, 11, 33, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 33, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/379a48ae-b2b2-47ac-abda-6414b58677bd/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359917e5a0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54280ea9-73c9-4f56-b3f2-db543bbb9687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Volume volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c (2add293b-ba2f-462c-a0dc-1ecfe3b1a46c): created successfully
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54280ea9-73c9-4f56-b3f2-db543bbb9687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Flow 'volume_create_manager' (a0baed3c-ba9d-42a9-aa90-14d214a6bed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f27c5294-84d4-4129-9560-4774549e55f0 tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Created volume successfully.
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Acquiring lock "cinder-34dc6f72-0314-4444-bd55-007ef9efa5fe-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "cinder-34dc6f72-0314-4444-bd55-007ef9efa5fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Acquiring lock "cinder-quobyte-34dc6f72-0314-4444-bd55-007ef9efa5fe" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "cinder-quobyte-34dc6f72-0314-4444-bd55-007ef9efa5fe" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071211d-1916-42ea-8a07-d4d73333c68d]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:22 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c 1G" returned: 0 in 0.834s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f21292-f482-408a-9784-7b6ec65d0f4d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:22 devstack sudo[102804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:22 devstack sudo[102805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f21292-f482-408a-9784-7b6ec65d0f4d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c
Jul 06 13:33:22 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:22 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Acquiring lock "cinder-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "cinder-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=95,cinder:UPDATE=119,cinder:INSERT=36,cinder:DELETE=5 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Acquiring lock "cinder-quobyte-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "cinder-quobyte-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[86190643-1cc9-44c0-a8c4-0b7c5a18f378]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:22 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:22 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:23 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 0 in 0.844s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:23 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71f21292-f482-408a-9784-7b6ec65d0f4d -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c" returned: 0 in 0.812s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:23 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c is being set with open permissions: ugo+rw
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:23 devstack sudo[102817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c
Jul 06 13:33:23 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:23 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:23 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:23 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:23 devstack sudo[102822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:23 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:23 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c" returned: 0 in 0.668s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:23 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 1 in 0.779s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:23 devstack sudo[102828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info
Jul 06 13:33:23 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:23 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe
Jul 06 13:33:23 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:24 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 1 in 0.800s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:24 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c
Jul 06 13:33:24 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:24 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info" returned: 0 in 0.706s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:24 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info is being set with open permissions: ugo+rw
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:24 devstack sudo[102839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info
Jul 06 13:33:24 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:24 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-34dc6f72-0314-4444-bd55-007ef9efa5fe" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "cinder-quobyte-34dc6f72-0314-4444-bd55-007ef9efa5fe" released by "delete_volume" :: held 2.443s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Created reservations ['0620f3bc-0951-42b8-8c27-38184f339685', '7b612997-36c6-4080-83a4-d425bf555ee4', '96af4853-e7bc-462d-bc00-7bcfb3020fcd', '2c9e12dc-007a-4a17-adf0-99dfe222e2fd'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:24 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:24 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:24 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "cinder-quobyte-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c" released by "delete_volume" :: held 2.386s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:24 devstack cinder-volume[86698]: WARNING cinder.quota [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:33:24 devstack cinder-volume[86698]: WARNING cinder.quota [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 13:33:24 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Created reservations ['9a06f7cf-3ca8-4171-bc42-5ac1557a88b9', '664ab51d-eb63-42f0-b640-88a6b88296f2', 'bcfed259-cbb4-4470-8df8-487cf01fa1f9', '76bc64db-67bb-4488-a713-929de84fb18f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:25 devstack sudo[102844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:25 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:25 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.info" returned: 0 in 0.714s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.610s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0168ca8d-d76f-4719-b4a0-e3d5ec09b8a2 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Create snapshot completed successfully
Jul 06 13:33:25 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.707s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Deleted volume successfully.
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65ae649e-a5ff-4066-af21-3d4bb02251af tempest-VolumesImageMetadata-2127684647 None] Lock "cinder-34dc6f72-0314-4444-bd55-007ef9efa5fe-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:25 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.815s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Deleted volume successfully.
Jul 06 13:33:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a5cc335c-7b59-4549-943f-661914f9198a tempest-VolumeAndVolumeTypeFromImageTest-441994063 None] Lock "cinder-2add293b-ba2f-462c-a0dc-1ecfe3b1a46c-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (ec45ee1a-1c8f-4b12-b191-a4edfe1afecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccd00e4-b499-4c39-974a-e3d5020b1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccd00e4-b499-4c39-974a-e3d5020b1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614755368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d00a274-0af5-4394-af5c-3186a46b6cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:26Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358aeb1e-7d2a-4a05-adbb-cb09eef97c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358aeb1e-7d2a-4a05-adbb-cb09eef97c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c22cf6-dd11-4374-88e3-e39e6b5f5949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c22cf6-dd11-4374-88e3-e39e6b5f5949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d00a274-0af5-4394-af5c-3186a46b6cdf', 'volume_name': 'volume-3d00a274-0af5-4394-af5c-3186a46b6cdf', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010948c-ee5f-43ab-b5c7-ea8410de118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010948c-ee5f-43ab-b5c7-ea8410de118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a926f5b-7d3b-482e-8f48-de535ed945fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume 3d00a274-0af5-4394-af5c-3186a46b6cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d00a274-0af5-4394-af5c-3186a46b6cdf', 'volume_size': 1}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614755368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d00a274-0af5-4394-af5c-3186a46b6cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:26Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume 3d00a274-0af5-4394-af5c-3186a46b6cdf {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:26 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:26 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf 1073741824
Jul 06 13:33:26 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (5156b852-64e9-4e38-abfd-2c296bbc89b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8613b185-e55e-4cd5-acce-f04865d6c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8613b185-e55e-4cd5-acce-f04865d6c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840241383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f7deaa-0a7e-455d-b3c0-760473569bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:27Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ea157e-2dcb-4023-bc91-b6fd9e534199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ea157e-2dcb-4023-bc91-b6fd9e534199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811f22d1-382b-425e-b31b-d44f070941a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811f22d1-382b-425e-b31b-d44f070941a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f7deaa-0a7e-455d-b3c0-760473569bec', 'volume_name': 'volume-d3f7deaa-0a7e-455d-b3c0-760473569bec', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a1bbcd-161b-43f3-82f6-b91e4082cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a1bbcd-161b-43f3-82f6-b91e4082cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1573e8cb-3120-40f1-90d3-32ee2401b685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume d3f7deaa-0a7e-455d-b3c0-760473569bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f7deaa-0a7e-455d-b3c0-760473569bec', 'volume_size': 1}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (0a31c185-4e00-4cdc-b98f-704e32fa173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d6619-400d-4ee4-a560-e9a761d9d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e3d6619-400d-4ee4-a560-e9a761d9d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284703099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a5f010-e459-420a-a06a-fb5db550e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:28Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e815c15-2110-426b-a2d1-30bdb6d16a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e815c15-2110-426b-a2d1-30bdb6d16a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062505c0-f2a7-4504-abe5-c6a4d04c1804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062505c0-f2a7-4504-abe5-c6a4d04c1804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a5f010-e459-420a-a06a-fb5db550e625', 'volume_name': 'volume-19a5f010-e459-420a-a06a-fb5db550e625', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97253555-7ea0-46e3-b5c2-1bd1af548c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97253555-7ea0-46e3-b5c2-1bd1af548c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee87519c-a626-45b1-be64-81e679fab70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume 19a5f010-e459-420a-a06a-fb5db550e625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a5f010-e459-420a-a06a-fb5db550e625', 'volume_size': 1}
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:27 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf 1073741824" returned: 0 in 1.271s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:28 devstack sudo[102856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf
Jul 06 13:33:28 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (8bd46359-3371-4e38-8f21-30c298be6d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c8c79e-f7c5-4109-a317-b50920cd5b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c8c79e-f7c5-4109-a317-b50920cd5b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613505936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2814af-5e6e-42b7-b33a-78948cbac537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:28Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33e6047-2779-44eb-ac31-e758b3fd0c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33e6047-2779-44eb-ac31-e758b3fd0c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73de2c20-bf49-4c20-9e6e-14fcfe417c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73de2c20-bf49-4c20-9e6e-14fcfe417c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d2814af-5e6e-42b7-b33a-78948cbac537', 'volume_name': 'volume-8d2814af-5e6e-42b7-b33a-78948cbac537', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835aa071-2500-4b4b-ab84-0010f0833f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835aa071-2500-4b4b-ab84-0010f0833f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c184eb-1e2e-4fe1-a269-7b69524b9ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume 8d2814af-5e6e-42b7-b33a-78948cbac537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d2814af-5e6e-42b7-b33a-78948cbac537', 'volume_size': 1}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (654940d6-8469-4725-b79f-626da2576664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f69d8e5-2f5a-49c3-8357-49d7f70d5ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f69d8e5-2f5a-49c3-8357-49d7f70d5ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016874386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d588739-e74d-439a-a14f-c4749f6a4f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:29Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d296a64b-e508-4cc3-8981-9a67cb19a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d296a64b-e508-4cc3-8981-9a67cb19a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a60186-4c1c-4b45-a7f1-92bb9851dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a60186-4c1c-4b45-a7f1-92bb9851dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d588739-e74d-439a-a14f-c4749f6a4f81', 'volume_name': 'volume-2d588739-e74d-439a-a14f-c4749f6a4f81', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a925b829-e282-4723-99d6-e8d4c99b2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a925b829-e282-4723-99d6-e8d4c99b2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae10483-a165-4ab4-be3d-c7f37232d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume 2d588739-e74d-439a-a14f-c4749f6a4f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d588739-e74d-439a-a14f-c4749f6a4f81', 'volume_size': 1}
Jul 06 13:33:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:29 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf" returned: 0 in 1.034s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.888s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840241383',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f7deaa-0a7e-455d-b3c0-760473569bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:27Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume d3f7deaa-0a7e-455d-b3c0-760473569bec {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:29 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a926f5b-7d3b-482e-8f48-de535ed945fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d00a274-0af5-4394-af5c-3186a46b6cdf', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a652a883-2302-44b4-9708-170db6c577a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:29 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec 1073741824
Jul 06 13:33:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-3d00a274-0af5-4394-af5c-3186a46b6cdf (3d00a274-0af5-4394-af5c-3186a46b6cdf): created successfully
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a652a883-2302-44b4-9708-170db6c577a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:29 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (ec45ee1a-1c8f-4b12-b191-a4edfe1afecb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9d1d8a91-5ee6-4e2c-a9ff-bae3a9dd6e6e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:30 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec 1073741824" returned: 0 in 1.064s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:30 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec
Jul 06 13:33:30 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:30 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec" returned: 0 in 0.762s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.075s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284703099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a5f010-e459-420a-a06a-fb5db550e625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:28Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume 19a5f010-e459-420a-a06a-fb5db550e625 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1573e8cb-3120-40f1-90d3-32ee2401b685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f7deaa-0a7e-455d-b3c0-760473569bec', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dcba93-6331-483c-8df1-1a0c01b5a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:30 devstack sudo[102869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 1073741824
Jul 06 13:33:30 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-d3f7deaa-0a7e-455d-b3c0-760473569bec (d3f7deaa-0a7e-455d-b3c0-760473569bec): created successfully
Jul 06 13:33:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dcba93-6331-483c-8df1-1a0c01b5a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (5156b852-64e9-4e38-abfd-2c296bbc89b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-547de8e7-e5e1-48b5-aa04-b4cad6089ac0 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:31 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 1073741824" returned: 0 in 0.976s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (e54eb763-fd50-4e4a-87b5-817c81d36a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba49d1cb-1006-4428-860c-e002091d2cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba49d1cb-1006-4428-860c-e002091d2cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673513774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a99f5f0-6ca5-4a08-883c-992e5485b820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:32Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625
Jul 06 13:33:32 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe2a4e9-f9db-4945-8dc5-7d834928b629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe2a4e9-f9db-4945-8dc5-7d834928b629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc98313-4390-4716-b106-cba59c763f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc98313-4390-4716-b106-cba59c763f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a99f5f0-6ca5-4a08-883c-992e5485b820', 'volume_name': 'volume-6a99f5f0-6ca5-4a08-883c-992e5485b820', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32440e9-eec8-4747-840e-c1b1a8885041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32440e9-eec8-4747-840e-c1b1a8885041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5801f5-5ec1-432e-9222-9a813993f387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Volume 6a99f5f0-6ca5-4a08-883c-992e5485b820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a99f5f0-6ca5-4a08-883c-992e5485b820', 'volume_size': 1}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (72383ae2-fe28-4982-910a-67051eb7682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678152f7-1e8e-4e91-a86e-a67321cb09c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678152f7-1e8e-4e91-a86e-a67321cb09c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594076438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8467f855-1674-4e63-94eb-27cca2c3fb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:32Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f1b0c6-3da7-4ba0-94f8-8ad4358fd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f1b0c6-3da7-4ba0-94f8-8ad4358fd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e18b3b0-143a-4614-9abc-cfeb28e209b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e18b3b0-143a-4614-9abc-cfeb28e209b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8467f855-1674-4e63-94eb-27cca2c3fb74', 'volume_name': 'volume-8467f855-1674-4e63-94eb-27cca2c3fb74', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e40ca1-1020-441c-ac50-b461ef3d40b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e40ca1-1020-441c-ac50-b461ef3d40b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f88e51a-9c94-4704-9084-9becc6c3d04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Volume 8467f855-1674-4e63-94eb-27cca2c3fb74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8467f855-1674-4e63-94eb-27cca2c3fb74', 'volume_size': 1}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (f4475fff-86d7-4f18-a409-2730214ac132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea97f6a-2bcf-47cb-9b13-78a1893a5dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ea97f6a-2bcf-47cb-9b13-78a1893a5dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731935371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aec20c1-3c53-40c5-9b1c-a06cf9593f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:33Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea39800-6c53-46c1-addc-a1b299d7b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea39800-6c53-46c1-addc-a1b299d7b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8cbe80-0bff-4e03-b636-48035b95cb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8cbe80-0bff-4e03-b636-48035b95cb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aec20c1-3c53-40c5-9b1c-a06cf9593f3a', 'volume_name': 'volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce7c406-1064-40eb-b548-c2199e897834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce7c406-1064-40eb-b548-c2199e897834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6570573-11c6-4361-b6c3-e56be5f11dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Volume 3aec20c1-3c53-40c5-9b1c-a06cf9593f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a', 'volume_size': 1}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:32 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625" returned: 0 in 0.890s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.434s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-613505936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d2814af-5e6e-42b7-b33a-78948cbac537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:28Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume 8d2814af-5e6e-42b7-b33a-78948cbac537 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:32 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:32 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 1073741824
Jul 06 13:33:32 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee87519c-a626-45b1-be64-81e679fab70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a5f010-e459-420a-a06a-fb5db550e625', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9181a69-485f-45be-b81b-d76d37685832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-19a5f010-e459-420a-a06a-fb5db550e625 (19a5f010-e459-420a-a06a-fb5db550e625): created successfully
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9181a69-485f-45be-b81b-d76d37685832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (0a31c185-4e00-4cdc-b98f-704e32fa173f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-83812d43-f965-4baa-abf3-9f8919e3fb68 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (f1747e10-6421-4eb4-9e2d-ee92df8ea5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef32882a-a6e0-4f1e-b7d9-21442b74495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef32882a-a6e0-4f1e-b7d9-21442b74495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614198088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d34a28-74d9-441b-9e0a-a2b45ba744f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:33Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af470570-2d51-4647-8239-fc7306721ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af470570-2d51-4647-8239-fc7306721ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f5fd9b-7474-4ba1-8298-c8d14935d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f5fd9b-7474-4ba1-8298-c8d14935d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d34a28-74d9-441b-9e0a-a2b45ba744f6', 'volume_name': 'volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9159c9-d759-41bc-94ec-a74f59e8c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9159c9-d759-41bc-94ec-a74f59e8c416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e22218-188c-4f0e-aa9e-cb8a2a79d818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Volume a8d34a28-74d9-441b-9e0a-a2b45ba744f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6', 'volume_size': 1}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (982c200f-221e-4652-af44-55c6e5032780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8287b445-9115-4482-8911-2fc3e73f575e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8287b445-9115-4482-8911-2fc3e73f575e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236872829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca16ca48-b30f-4e00-b11b-18343aa86641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:34Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03e2f14-8448-4bbb-a290-d9fbb52d03dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03e2f14-8448-4bbb-a290-d9fbb52d03dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e729ae7-a42f-4adc-9ee1-fc9092bd1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e729ae7-a42f-4adc-9ee1-fc9092bd1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca16ca48-b30f-4e00-b11b-18343aa86641', 'volume_name': 'volume-ca16ca48-b30f-4e00-b11b-18343aa86641', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c66e6b7-b60b-463c-8251-896fd9d5eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c66e6b7-b60b-463c-8251-896fd9d5eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3ed101-a102-46ef-a593-7c5d7354a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Volume ca16ca48-b30f-4e00-b11b-18343aa86641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca16ca48-b30f-4e00-b11b-18343aa86641', 'volume_size': 1}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Flow 'volume_create_manager' (7ad326f2-1412-4cd5-adff-36842c466591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f31e0fe-6f4d-4895-a086-55be3a032033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f31e0fe-6f4d-4895-a086-55be3a032033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1588889434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a70153a-b832-47d6-8ca4-809f3424b381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1bb2a9f37f44ca5a23c8827f0abce4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:34Z,use_quota=True,user_id='60a0026ee1194af09a4419cb6dcbeffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49788c0b-90b6-4814-99bf-5fa327caefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49788c0b-90b6-4814-99bf-5fa327caefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106b9054-1966-46f5-9175-cf5d5d0800a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106b9054-1966-46f5-9175-cf5d5d0800a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a70153a-b832-47d6-8ca4-809f3424b381', 'volume_name': 'volume-7a70153a-b832-47d6-8ca4-809f3424b381', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2382f113-64f0-4964-8e74-1dc7e772e8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2382f113-64f0-4964-8e74-1dc7e772e8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f2ea00-0cac-456a-84ba-784e1d176ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:33 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Volume 7a70153a-b832-47d6-8ca4-809f3424b381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a70153a-b832-47d6-8ca4-809f3424b381', 'volume_size': 1}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 1073741824" returned: 0 in 1.048s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:34 devstack sudo[102884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537
Jul 06 13:33:34 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:34 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.770s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2016874386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d588739-e74d-439a-a14f-c4749f6a4f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e86b569a17c451d8af6dbed4f06a458',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:29Z,use_quota=True,user_id='8e58366f88df499c9bd45bebab6dc323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Creating volume 2d588739-e74d-439a-a14f-c4749f6a4f81 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:34 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:34 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 1073741824
Jul 06 13:33:34 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c184eb-1e2e-4fe1-a269-7b69524b9ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d2814af-5e6e-42b7-b33a-78948cbac537', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11083d6-a87f-4f80-9804-6c0fd4c03b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-8d2814af-5e6e-42b7-b33a-78948cbac537 (8d2814af-5e6e-42b7-b33a-78948cbac537): created successfully
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11083d6-a87f-4f80-9804-6c0fd4c03b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (8bd46359-3371-4e38-8f21-30c298be6d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ce351222-ec65-4853-9f8d-a4cb2c1e283f tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:35 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 1073741824" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:35 devstack sudo[102892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81
Jul 06 13:33:35 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:36 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.040s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-673513774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a99f5f0-6ca5-4a08-883c-992e5485b820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:32Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Creating volume 6a99f5f0-6ca5-4a08-883c-992e5485b820 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:36 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:36 devstack sudo[102895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 1073741824
Jul 06 13:33:36 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae10483-a165-4ab4-be3d-c7f37232d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d588739-e74d-439a-a14f-c4749f6a4f81', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e62bfd5-d655-487a-a6d5-049d4690d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Volume volume-2d588739-e74d-439a-a14f-c4749f6a4f81 (2d588739-e74d-439a-a14f-c4749f6a4f81): created successfully
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e62bfd5-d655-487a-a6d5-049d4690d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Flow 'volume_create_manager' (654940d6-8469-4725-b79f-626da2576664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3d054dc7-11d8-459c-bc28-0fd075fda66e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created volume successfully.
Jul 06 13:33:37 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 1073741824" returned: 0 in 0.866s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-2d588739-e74d-439a-a14f-c4749f6a4f81-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-2d588739-e74d-439a-a14f-c4749f6a4f81-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:37 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820
Jul 06 13:33:37 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-2d588739-e74d-439a-a14f-c4749f6a4f81" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-2d588739-e74d-439a-a14f-c4749f6a4f81" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b2e8f9-d4b0-40e3-b806-0fb08092b46a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:37 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81
Jul 06 13:33:37 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:37 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.191s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594076438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8467f855-1674-4e63-94eb-27cca2c3fb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:32Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Creating volume 8467f855-1674-4e63-94eb-27cca2c3fb74 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:37 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:37 devstack sudo[102906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 1073741824
Jul 06 13:33:37 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5801f5-5ec1-432e-9222-9a813993f387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a99f5f0-6ca5-4a08-883c-992e5485b820', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9e0e8a-3459-4d3e-b41c-893466425694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:37 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Volume volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 (6a99f5f0-6ca5-4a08-883c-992e5485b820): created successfully
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9e0e8a-3459-4d3e-b41c-893466425694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (e54eb763-fd50-4e4a-87b5-817c81d36a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6a7109bf-65ce-461f-b544-cd63d6c08c05 tempest-CreateVolumesFromImageTest-302115579 None] Created volume successfully.
Jul 06 13:33:37 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81" returned: 0 in 0.812s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:37 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81
Jul 06 13:33:37 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:38 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 1073741824" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:38 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2d588739-e74d-439a-a14f-c4749f6a4f81" returned: 0 in 0.649s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-2d588739-e74d-439a-a14f-c4749f6a4f81" released by "delete_volume" :: held 1.508s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:38 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74
Jul 06 13:33:38 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['359cda76-4e5b-4479-bbef-4dce2c2562d6', '34cdb9ed-e046-4bcd-9597-ae0c5f6d51ee', 'd4f78e05-8c3e-4e7e-ad8d-286e4e57ae35', 'ceb3a69b-7d32-41d1-90ef-6bd77698ea43'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:38 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:38 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-8d2814af-5e6e-42b7-b33a-78948cbac537-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:39 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74" returned: 0 in 0.665s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.402s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-731935371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aec20c1-3c53-40c5-9b1c-a06cf9593f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:33Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Creating volume 3aec20c1-3c53-40c5-9b1c-a06cf9593f3a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:39 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-8d2814af-5e6e-42b7-b33a-78948cbac537-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:39 devstack sudo[102923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a 1073741824
Jul 06 13:33:39 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f88e51a-9c94-4704-9084-9becc6c3d04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8467f855-1674-4e63-94eb-27cca2c3fb74', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e097fa0-8fd1-42f3-92da-22e3bc6b2269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-8d2814af-5e6e-42b7-b33a-78948cbac537" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Volume volume-8467f855-1674-4e63-94eb-27cca2c3fb74 (8467f855-1674-4e63-94eb-27cca2c3fb74): created successfully
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e097fa0-8fd1-42f3-92da-22e3bc6b2269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (72383ae2-fe28-4982-910a-67051eb7682d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-8d2814af-5e6e-42b7-b33a-78948cbac537" acquired by "delete_volume" :: waited 0.041s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:39 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.676s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a4517f88-36c7-49a6-aa15-a0648443e0f3 tempest-CreateVolumesFromImageTest-302115579 None] Created volume successfully.
Jul 06 13:33:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[458b870d-9377-41fa-9f3d-a68062e2e875]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5dd48d0c-2fa0-48f3-9730-93df7f0d64f3 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-2d588739-e74d-439a-a14f-c4749f6a4f81-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:39 devstack sudo[102925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537
Jul 06 13:33:39 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:40 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a 1073741824" returned: 0 in 0.879s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:40 devstack sudo[102933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a
Jul 06 13:33:40 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:40 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537" returned: 0 in 0.825s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:40 devstack sudo[102935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537
Jul 06 13:33:40 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:40 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" returned: 0 in 0.622s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.500s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1614198088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d34a28-74d9-441b-9e0a-a2b45ba744f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:33Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Creating volume a8d34a28-74d9-441b-9e0a-a2b45ba744f6 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:40 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:40 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 1073741824
Jul 06 13:33:40 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6570573-11c6-4361-b6c3-e56be5f11dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e685933-bf04-4452-8217-79b56dded4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:40 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Volume volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a (3aec20c1-3c53-40c5-9b1c-a06cf9593f3a): created successfully
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e685933-bf04-4452-8217-79b56dded4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (f4475fff-86d7-4f18-a409-2730214ac132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b90c7c9b-21ee-41ce-b74f-048b89f233ac tempest-CreateVolumesFromImageTest-302115579 None] Created volume successfully.
Jul 06 13:33:40 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8d2814af-5e6e-42b7-b33a-78948cbac537" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-8d2814af-5e6e-42b7-b33a-78948cbac537" released by "delete_volume" :: held 1.541s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['1db32a96-513c-4674-b133-452608a11328', '38fd87b4-731c-43a9-a395-721998e89b69', 'd77f99b5-6017-441b-858d-6f78533e8567', 'a4ff6d36-d34e-4e55-bdf1-39398602e709'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:41 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:41 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-19a5f010-e459-420a-a06a-fb5db550e625-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-19a5f010-e459-420a-a06a-fb5db550e625-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-19a5f010-e459-420a-a06a-fb5db550e625" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-19a5f010-e459-420a-a06a-fb5db550e625" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c7fa8a-6190-4bfc-bdf0-73b5e94546c8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:41 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625
Jul 06 13:33:41 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:41 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 1073741824" returned: 0 in 0.922s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:41 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:41 devstack sudo[102950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6
Jul 06 13:33:41 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-01e4b395-aca4-406f-8002-de296521d3f7 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-8d2814af-5e6e-42b7-b33a-78948cbac537-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:42 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625" returned: 0 in 0.818s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:42 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" returned: 0 in 0.665s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:42 devstack sudo[102956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625
Jul 06 13:33:42 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.715s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-236872829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca16ca48-b30f-4e00-b11b-18343aa86641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05acabb3867644b7bec56138e1809c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:34Z,use_quota=True,user_id='f1e9822349c841ecb248ff7c29501931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Creating volume ca16ca48-b30f-4e00-b11b-18343aa86641 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:42 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e22218-188c-4f0e-aa9e-cb8a2a79d818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb2fb22-54cf-4123-bc30-1779d8878140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:42 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 1073741824
Jul 06 13:33:42 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Volume volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 (a8d34a28-74d9-441b-9e0a-a2b45ba744f6): created successfully
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb2fb22-54cf-4123-bc30-1779d8878140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (f1747e10-6421-4eb4-9e2d-ee92df8ea5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7985bbeb-517c-46b9-b9f2-3c7feb6a2bd0 tempest-CreateVolumesFromImageTest-302115579 None] Created volume successfully.
Jul 06 13:33:43 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-19a5f010-e459-420a-a06a-fb5db550e625" returned: 0 in 0.676s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-19a5f010-e459-420a-a06a-fb5db550e625" released by "delete_volume" :: held 1.549s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['8f23e20d-1eab-424f-a27c-58c887881ec7', '508617ac-1b39-40ed-971b-81b5a5b1d8e7', '6862b462-d643-44b0-b028-80f6a4323559', '4bb88c30-4673-4c0c-9779-b6cdf967e67d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:43 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:43 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:43 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 1073741824" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:43 devstack sudo[102968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641
Jul 06 13:33:43 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-d3f7deaa-0a7e-455d-b3c0-760473569bec-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-d3f7deaa-0a7e-455d-b3c0-760473569bec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-d3f7deaa-0a7e-455d-b3c0-760473569bec" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-d3f7deaa-0a7e-455d-b3c0-760473569bec" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bfe7d0-e4bb-416d-a34a-1393574eea8f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:43 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.660s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f3986c7b-0aef-417c-9430-b8dc9e225261 tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-19a5f010-e459-420a-a06a-fb5db550e625-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:44 devstack sudo[102971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec
Jul 06 13:33:44 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:44 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641" returned: 0 in 0.709s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.146s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1588889434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a70153a-b832-47d6-8ca4-809f3424b381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1bb2a9f37f44ca5a23c8827f0abce4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:34Z,use_quota=True,user_id='60a0026ee1194af09a4419cb6dcbeffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Creating volume 7a70153a-b832-47d6-8ca4-809f3424b381 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:44 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:44 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 1073741824
Jul 06 13:33:44 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3ed101-a102-46ef-a593-7c5d7354a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca16ca48-b30f-4e00-b11b-18343aa86641', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a892bd-8102-47ca-8a9f-392eaa25375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:44 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Volume volume-ca16ca48-b30f-4e00-b11b-18343aa86641 (ca16ca48-b30f-4e00-b11b-18343aa86641): created successfully
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a892bd-8102-47ca-8a9f-392eaa25375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Flow 'volume_create_manager' (982c200f-221e-4652-af44-55c6e5032780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f33aa4fc-ba3b-461a-9b11-97f8c3c947ad tempest-CreateVolumesFromImageTest-302115579 None] Created volume successfully.
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-ca16ca48-b30f-4e00-b11b-18343aa86641-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-ca16ca48-b30f-4e00-b11b-18343aa86641-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:44 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec" returned: 0 in 0.875s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:44 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec
Jul 06 13:33:44 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-quobyte-ca16ca48-b30f-4e00-b11b-18343aa86641" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-ca16ca48-b30f-4e00-b11b-18343aa86641" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d2b98c-621d-48f8-955a-a20165c7e6c3]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:45 devstack sudo[102984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641
Jul 06 13:33:45 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:45 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 1073741824" returned: 0 in 1.098s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:45 devstack sudo[102989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381
Jul 06 13:33:45 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:45 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d3f7deaa-0a7e-455d-b3c0-760473569bec" returned: 0 in 0.801s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-d3f7deaa-0a7e-455d-b3c0-760473569bec" released by "delete_volume" :: held 1.752s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['4aa18218-9826-44a9-90a1-f7806e429d61', '75380a76-2e04-49a5-b3f8-ffdfa090a9e5', '3e9475f3-6e68-481d-b5ff-953a5ed19eba', 'c4df11f7-bbf2-4d05-a35f-06c5e8dd897b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:45 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641" returned: 0 in 0.872s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:45 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:45 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:45 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641
Jul 06 13:33:45 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:46 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-3d00a274-0af5-4394-af5c-3186a46b6cdf-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381" returned: 0 in 0.771s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-3d00a274-0af5-4394-af5c-3186a46b6cdf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f2ea00-0cac-456a-84ba-784e1d176ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a70153a-b832-47d6-8ca4-809f3424b381', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b5f705-9bc9-47be-816b-50e340160ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Volume volume-7a70153a-b832-47d6-8ca4-809f3424b381 (7a70153a-b832-47d6-8ca4-809f3424b381): created successfully
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b5f705-9bc9-47be-816b-50e340160ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Flow 'volume_create_manager' (7ad326f2-1412-4cd5-adff-36842c466591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-3d00a274-0af5-4394-af5c-3186a46b6cdf" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ce5667cd-8bf4-4765-b8ba-32f91f897320 tempest-AbsoluteLimitsTests-1858141953 None] Created volume successfully.
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-3d00a274-0af5-4394-af5c-3186a46b6cdf" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00de202-42a2-43e0-837a-9bb99eaac6c0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:46 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf
Jul 06 13:33:46 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:46 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2107ec83-4b18-4bf6-817c-d3bec4d4b2da tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-d3f7deaa-0a7e-455d-b3c0-760473569bec-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:46 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ca16ca48-b30f-4e00-b11b-18343aa86641" returned: 0 in 0.766s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-ca16ca48-b30f-4e00-b11b-18343aa86641" released by "delete_volume" :: held 1.692s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Created reservations ['81190742-9450-43ae-bba3-2a1895a9de47', '91829959-46fb-49eb-ab60-7909596c98f4', 'ec40ea26-2c6b-414a-94c2-301d10eb29f3', '1a36135f-ae69-424c-9c6f-1f418932e504'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:46 devstack sudo[103004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:46 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Acquiring lock "cinder-7a70153a-b832-47d6-8ca4-809f3424b381-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "cinder-7a70153a-b832-47d6-8ca4-809f3424b381-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-a8d34a28-74d9-441b-9e0a-a2b45ba744f6-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-a8d34a28-74d9-441b-9e0a-a2b45ba744f6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Acquiring lock "cinder-quobyte-7a70153a-b832-47d6-8ca4-809f3424b381" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "cinder-quobyte-7a70153a-b832-47d6-8ca4-809f3424b381" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:47 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf" returned: 0 in 0.910s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2f59f-616b-40bc-b445-5918b1777d50]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:47 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf
Jul 06 13:33:47 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-quobyte-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ec55bf-cff2-42df-9e58-4442c4d18dd9]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:47 devstack sudo[103012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381
Jul 06 13:33:47 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:47 devstack sudo[103014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6
Jul 06 13:33:47 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:47 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.822s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:47 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Deleted volume successfully.
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-58583a35-1a03-41b1-afc6-ca53ac053610 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-ca16ca48-b30f-4e00-b11b-18343aa86641-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:47 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3d00a274-0af5-4394-af5c-3186a46b6cdf" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-3d00a274-0af5-4394-af5c-3186a46b6cdf" released by "delete_volume" :: held 1.689s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['8b164e2e-cbdd-472f-83ff-83b35fcef366', 'a34d1a0e-fbb9-4242-8f7b-9ec6389613de', '40e0ed7a-b459-4651-bc8a-306ba26992ea', 'e0352889-788a-4c62-bb35-f5fc92978f21'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:47 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381" returned: 0 in 0.836s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:47 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381
Jul 06 13:33:47 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:48 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:48 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:48 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" returned: 0 in 0.901s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:48 devstack sudo[103029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6
Jul 06 13:33:48 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-479d7daf-5459-4d6e-9f73-f4d98491239c-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-479d7daf-5459-4d6e-9f73-f4d98491239c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-479d7daf-5459-4d6e-9f73-f4d98491239c" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-479d7daf-5459-4d6e-9f73-f4d98491239c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleting offline snapshot 479d7daf-5459-4d6e-9f73-f4d98491239c of volume 71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] snapshot_file for this snap is: volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[942393c8-026e-4175-950f-95fbde67f76f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:48 devstack sudo[103031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c
Jul 06 13:33:48 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:48 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7a70153a-b832-47d6-8ca4-809f3424b381" returned: 0 in 0.758s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "cinder-quobyte-7a70153a-b832-47d6-8ca4-809f3424b381" released by "delete_volume" :: held 1.662s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:48 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7bb48153-8c2d-42d3-8534-945da7a9515e tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-3d00a274-0af5-4394-af5c-3186a46b6cdf-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Created reservations ['41303020-cb33-4a1d-a452-7cdda003d34d', 'd66215d8-ece9-470f-be88-0c54a0f515d9', 'e6d0ad83-c25f-478a-a429-30f8f3770c99', '73b09943-e2b6-436f-9bd9-34c5a0d37310'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:48 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-a8d34a28-74d9-441b-9e0a-a2b45ba744f6" released by "delete_volume" :: held 1.697s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:48 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:48 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Created reservations ['8156bba5-ed59-443d-b200-19d060562a67', '39306d0a-86a5-40cb-a93a-383eaaad5bd0', 'b64f7da7-00be-4f44-84e6-b2459f4f7bf3', '36bd6ad2-f3be-44ea-a4d0-0f578c033c67'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:49 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:49 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-quobyte-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:49 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71f21292-f482-408a-9784-7b6ec65d0f4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e214f1cf-90be-4e93-99ca-964609ffd696]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[221c80f9-73a8-41a4-b912-1a737516ceda]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:49 devstack sudo[103043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a
Jul 06 13:33:49 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:49 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d
Jul 06 13:33:49 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:49 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.869s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Deleted volume successfully.
Jul 06 13:33:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-489dec4a-5f92-4a64-b113-52dddc89f25f tempest-AbsoluteLimitsTests-1858141953 None] Lock "cinder-7a70153a-b832-47d6-8ca4-809f3424b381-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:50 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.010s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Deleted volume successfully.
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-74bd1822-0ab1-427b-b610-1414af1bc285 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-a8d34a28-74d9-441b-9e0a-a2b45ba744f6-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:50 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d" returned: 0 in 0.913s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:50 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" returned: 0 in 0.941s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:50 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c
Jul 06 13:33:50 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:50 devstack sudo[103056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a
Jul 06 13:33:50 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:51 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c" returned: 0 in 0.847s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:51 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" returned: 0 in 0.844s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:51 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c
Jul 06 13:33:51 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a" released by "delete_volume" :: held 1.873s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Created reservations ['9191d4f8-9033-482e-bf54-a4d40b1b01ae', 'b6e3805e-626d-4950-8087-0833bc1497a2', '748acbe7-bca1-48a3-963f-50a5e00a28f5', '246e0dab-0269-48b1-9ceb-6e85aa025b7a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:51 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:51 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-8467f855-1674-4e63-94eb-27cca2c3fb74-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-8467f855-1674-4e63-94eb-27cca2c3fb74-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-quobyte-8467f855-1674-4e63-94eb-27cca2c3fb74" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-8467f855-1674-4e63-94eb-27cca2c3fb74" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c5e9b6-9018-42d3-8371-bd8b4e20587c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:51 devstack sudo[103067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74
Jul 06 13:33:51 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:52 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d.479d7daf-5459-4d6e-9f73-f4d98491239c" returned: 0 in 0.845s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-479d7daf-5459-4d6e-9f73-f4d98491239c" released by "_delete_snapshot" :: held 3.773s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" released by "delete_snapshot" :: held 3.803s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['56ec8a41-c589-4175-85ff-632f6dcc80c8', '050ae6d9-8c74-40d2-ba86-8b4aceb69d9b', 'bcc6629d-10ef-4b4d-abe5-2d8eae436f4c', '9b69d782-68b7-47c0-9d96-a04c34b130d6'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Delete snapshot completed successfully.
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a135011-37fa-4f85-92c8-bbc39d769aab tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-479d7daf-5459-4d6e-9f73-f4d98491239c-delete_snapshot" released by "delete_snapshot" :: held 4.021s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:52 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.031s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Deleted volume successfully.
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-0ab3cdf3-941a-4819-acdd-069d3e800ee0 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-3aec20c1-3c53-40c5-9b1c-a06cf9593f3a-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-71f21292-f482-408a-9784-7b6ec65d0f4d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-71f21292-f482-408a-9784-7b6ec65d0f4d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97ae897-da8d-44f9-8c76-e54ee3f81170]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:52 devstack sudo[103074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d
Jul 06 13:33:52 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:52 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74" returned: 0 in 1.019s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:52 devstack sudo[103076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74
Jul 06 13:33:52 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:53 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d" returned: 0 in 0.853s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:53 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8467f855-1674-4e63-94eb-27cca2c3fb74" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:53 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d
Jul 06 13:33:53 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-8467f855-1674-4e63-94eb-27cca2c3fb74" released by "delete_volume" :: held 1.822s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Created reservations ['e91e1707-2c9e-473a-b772-07cb535a1a47', '3150caea-48f1-40ba-a3f1-c2707f3b4689', '7a290bb1-dcfc-4100-bfa9-d673753aa53d', 'be37566e-8564-43ca-bea5-217df7efa55e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:53 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:53 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-6a99f5f0-6ca5-4a08-883c-992e5485b820-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-6a99f5f0-6ca5-4a08-883c-992e5485b820-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "cinder-quobyte-6a99f5f0-6ca5-4a08-883c-992e5485b820" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-6a99f5f0-6ca5-4a08-883c-992e5485b820" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d368af-cb25-495c-ac94-644ec3d32232]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:54 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820
Jul 06 13:33:54 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:54 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-71f21292-f482-408a-9784-7b6ec65d0f4d" returned: 0 in 0.797s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-quobyte-71f21292-f482-408a-9784-7b6ec65d0f4d" released by "delete_volume" :: held 1.730s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Created reservations ['857589d4-6390-4def-94d5-d78e4ee21ace', '5b828ba0-5f71-4b90-8c66-112f4c9db320', '813329bc-f641-4ea1-81df-3bc205da9a42', '9e6f3df3-10d2-4aca-908b-51b0e5b2ade8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:54 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:54 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:54 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.892s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Deleted volume successfully.
Jul 06 13:33:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fb5a0ad5-e848-4902-a394-6bc765ad8dc9 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-8467f855-1674-4e63-94eb-27cca2c3fb74-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:55 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820" returned: 0 in 0.969s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:55 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820
Jul 06 13:33:55 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:55 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.826s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Deleted volume successfully.
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f54fa0cb-a0a5-40a1-87a5-59fbb7dabbce tempest-CreateVolumesFromSnapshotTest-1521802408 None] Lock "cinder-71f21292-f482-408a-9784-7b6ec65d0f4d-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:55 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6a99f5f0-6ca5-4a08-883c-992e5485b820" returned: 0 in 0.803s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-quobyte-6a99f5f0-6ca5-4a08-883c-992e5485b820" released by "delete_volume" :: held 1.838s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:55 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Created reservations ['666a72d7-7e1d-4a58-a68a-0907fec7fe96', '94f1437a-f291-4103-91ec-5d4a2b0ff6f2', '6afb6ba5-b7e9-467d-bc0d-202e9f7c4983', 'f67e6d97-0520-422e-9d7c-812f849628a6'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:56 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:33:56 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Flow 'volume_create_manager' (f139119f-7dff-43a4-b689-a973d333a15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a4d66-4138-45a9-8222-49fa3e7b15df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a4d66-4138-45a9-8222-49fa3e7b15df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948752523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad011fc-78ef-47bf-9d03-ffa5fa4affda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b20b3fe8a4414bb708a3278715a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:57Z,use_quota=True,user_id='8bb11934883b4817a943f9440d4d6e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14495222-92ae-4e4e-b4e5-08a8acbb7cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14495222-92ae-4e4e-b4e5-08a8acbb7cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b807d894-f557-4fb5-b97c-84e4557f458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b807d894-f557-4fb5-b97c-84e4557f458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad011fc-78ef-47bf-9d03-ffa5fa4affda', 'volume_name': 'volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94366c4d-0aff-4f02-baf1-b8391c666c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94366c4d-0aff-4f02-baf1-b8391c666c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca335735-fa49-4d23-bfa4-0e6df8a72816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:56 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Volume 7ad011fc-78ef-47bf-9d03-ffa5fa4affda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda', 'volume_size': 1}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-948752523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad011fc-78ef-47bf-9d03-ffa5fa4affda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b20b3fe8a4414bb708a3278715a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:57Z,use_quota=True,user_id='8bb11934883b4817a943f9440d4d6e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Creating volume 7ad011fc-78ef-47bf-9d03-ffa5fa4affda {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:56 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:57 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.929s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:57 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:33:57 devstack sudo[103104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda 1073741824
Jul 06 13:33:57 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Deleted volume successfully.
Jul 06 13:33:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1dda7b1f-729b-4083-80e9-cdd6640d7152 tempest-CreateVolumesFromImageTest-302115579 None] Lock "cinder-6a99f5f0-6ca5-4a08-883c-992e5485b820-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:33:57 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda 1073741824" returned: 0 in 1.014s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:58 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda
Jul 06 13:33:58 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (c1e412c0-361c-4f89-8707-8369fd3e1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9269bec-595e-4921-b677-47869ef30ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" returned: 0 in 0.701s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9269bec-595e-4921-b677-47869ef30ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-55075899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f4c6f1-c24e-4773-abd6-320914fb1559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:59Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47944229-e6bd-4007-909c-febbc7ba6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47944229-e6bd-4007-909c-febbc7ba6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3c1563-47b0-457c-881b-09229fe66d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3c1563-47b0-457c-881b-09229fe66d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f4c6f1-c24e-4773-abd6-320914fb1559', 'volume_name': 'volume-c4f4c6f1-c24e-4773-abd6-320914fb1559', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3da030-d686-4d89-aeed-664fccd31009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3da030-d686-4d89-aeed-664fccd31009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac729e0a-e5e0-460d-a4fc-508e96f2b2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume c4f4c6f1-c24e-4773-abd6-320914fb1559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f4c6f1-c24e-4773-abd6-320914fb1559', 'volume_size': 1}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-55075899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f4c6f1-c24e-4773-abd6-320914fb1559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:33:59Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume c4f4c6f1-c24e-4773-abd6-320914fb1559 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:33:58 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca335735-fa49-4d23-bfa4-0e6df8a72816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0054b8-272a-4e0e-94a7-223312f726b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:33:58 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 1073741824
Jul 06 13:33:58 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:33:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Volume volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda (7ad011fc-78ef-47bf-9d03-ffa5fa4affda): created successfully
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b0054b8-272a-4e0e-94a7-223312f726b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:33:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Flow 'volume_create_manager' (f139119f-7dff-43a4-b689-a973d333a15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:33:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7480f2cd-cf2f-4204-bbb8-a86ffaa8db54 tempest-VolumesTransfersV357Test-1111949858 None] Created volume successfully.
Jul 06 13:33:59 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Jul 06 13:33:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 1073741824" returned: 0 in 0.861s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:33:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:33:59 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559
Jul 06 13:33:59 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:00 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559" returned: 0 in 0.677s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac729e0a-e5e0-460d-a4fc-508e96f2b2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f4c6f1-c24e-4773-abd6-320914fb1559', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae92eba6-ca5e-45a7-a3ea-624b2d7c3642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 (c4f4c6f1-c24e-4773-abd6-320914fb1559): created successfully
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae92eba6-ca5e-45a7-a3ea-624b2d7c3642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (c1e412c0-361c-4f89-8707-8369fd3e1c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:00 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-49a2ad38-a6dd-4eb4-95dc-62841250693c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:00 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b07f73e6-a565-4fd4-847e-f309377e1e0a tempest-VolumesTransfersV357Test-667456676 None] Transfer volume completed successfully.
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (30f47a70-1002-4747-a1f2-7db8abbb01be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fceee4d-312c-437e-b6ee-b6dd1c130c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fceee4d-312c-437e-b6ee-b6dd1c130c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586088315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5a233-d268-41f4-a1a0-7d4fe74f4764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:01Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c993cff7-4b3d-4d29-83ff-314901e82dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c993cff7-4b3d-4d29-83ff-314901e82dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f40bf-3600-43a8-abe9-f9663b4f3b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (926f40bf-3600-43a8-abe9-f9663b4f3b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c5a233-d268-41f4-a1a0-7d4fe74f4764', 'volume_name': 'volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934937d9-cc6b-4b8e-82eb-2d0a5ab4ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934937d9-cc6b-4b8e-82eb-2d0a5ab4ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6df02-60c0-43a9-ac06-c8d639e7457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume 37c5a233-d268-41f4-a1a0-7d4fe74f4764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764', 'volume_size': 1}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-586088315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5a233-d268-41f4-a1a0-7d4fe74f4764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:01Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume 37c5a233-d268-41f4-a1a0-7d4fe74f4764 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:01 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:01 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 1073741824
Jul 06 13:34:01 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "cinder-7ad011fc-78ef-47bf-9d03-ffa5fa4affda-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-7ad011fc-78ef-47bf-9d03-ffa5fa4affda-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "cinder-quobyte-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-quobyte-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e65e9b-ffa5-43e6-97d7-117b05a57b9b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (c71cd6de-386b-44a7-93f6-9893f586ee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e123651-17b6-465a-9e56-12eb1c5385a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e123651-17b6-465a-9e56-12eb1c5385a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314795192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa44752f-b8de-4e1b-b7ea-1360b6b38bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:02Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731601fe-c96f-49b2-a8cf-28e4e9092bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731601fe-c96f-49b2-a8cf-28e4e9092bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653504f-fa7b-400a-8577-af52b9400b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653504f-fa7b-400a-8577-af52b9400b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa44752f-b8de-4e1b-b7ea-1360b6b38bc8', 'volume_name': 'volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f5544c-7284-4634-97e5-abda9d3cf235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f5544c-7284-4634-97e5-abda9d3cf235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873f047f-eeff-48cf-9d70-069a8e9be3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume fa44752f-b8de-4e1b-b7ea-1360b6b38bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8', 'volume_size': 1}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:02 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda
Jul 06 13:34:02 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (bbf96079-e7d6-4a16-bb84-567e83b0f1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c5e97-63e4-48ba-ac13-13f60ce7cf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4c5e97-63e4-48ba-ac13-13f60ce7cf39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694586402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e80c727-e1c0-4147-a819-f9e9e4a61c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:02Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14f0ec6-51d5-4d2c-9aca-8a4f75e518d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14f0ec6-51d5-4d2c-9aca-8a4f75e518d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ec0ea3-36a2-4e6b-9978-bdda3d477f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ec0ea3-36a2-4e6b-9978-bdda3d477f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e80c727-e1c0-4147-a819-f9e9e4a61c19', 'volume_name': 'volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21497317-37f4-4055-bce1-46244becc62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21497317-37f4-4055-bce1-46244becc62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c4a7b7-b972-4d50-82a8-dacec3a0b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume 9e80c727-e1c0-4147-a819-f9e9e4a61c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19', 'volume_size': 1}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:02 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 1073741824" returned: 0 in 1.280s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:02 devstack sudo[103129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764
Jul 06 13:34:02 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (214caaf1-5f98-4f3d-aa64-381703dfd07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c071d7-ccb2-4558-8a69-a57a746ee182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c071d7-ccb2-4558-8a69-a57a746ee182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1761108911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005fd82a-660e-4900-a3e4-f3cac8a3827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:03Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0121a1-84c8-4598-b453-39a38001c14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c0121a1-84c8-4598-b453-39a38001c14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee17b2a7-7b8d-44f2-a797-bf754d31befa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee17b2a7-7b8d-44f2-a797-bf754d31befa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005fd82a-660e-4900-a3e4-f3cac8a3827a', 'volume_name': 'volume-005fd82a-660e-4900-a3e4-f3cac8a3827a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197fba33-dd7a-4e79-b8d3-0fdf4fb1bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197fba33-dd7a-4e79-b8d3-0fdf4fb1bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f069fe43-a87a-45fb-8c5e-6be8c78ce7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume 005fd82a-660e-4900-a3e4-f3cac8a3827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005fd82a-660e-4900-a3e4-f3cac8a3827a', 'volume_size': 1}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" returned: 0 in 1.224s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:03 devstack sudo[103135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda
Jul 06 13:34:03 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:03 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764" returned: 0 in 0.798s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314795192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa44752f-b8de-4e1b-b7ea-1360b6b38bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:02Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:03 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:03 devstack sudo[103138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 1073741824
Jul 06 13:34:03 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (eceb9905-bce9-4e3d-86a4-5d5812c12dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe0f736-3dec-4f63-9919-e660d967da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4b6df02-60c0-43a9-ac06-c8d639e7457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e9b357-7a45-48a6-a76a-327cf83a9f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe0f736-3dec-4f63-9919-e660d967da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-429344073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7452e-e7b4-4a9d-8bb2-911039aeab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:03Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e752bd5-107f-4a5b-9bad-2de96fd48cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e752bd5-107f-4a5b-9bad-2de96fd48cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb0ae8-cfef-4cc2-a48f-0e6b93d56709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fb0ae8-cfef-4cc2-a48f-0e6b93d56709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d7452e-e7b4-4a9d-8bb2-911039aeab6e', 'volume_name': 'volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9273e87-db67-4ef2-a1f8-ae0d3ce206b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9273e87-db67-4ef2-a1f8-ae0d3ce206b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0fc2e1-4b3e-467c-9aac-915d88d3f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:03 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume 03d7452e-e7b4-4a9d-8bb2-911039aeab6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e', 'volume_size': 1}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:03 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 (37c5a233-d268-41f4-a1a0-7d4fe74f4764): created successfully
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e9b357-7a45-48a6-a76a-327cf83a9f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (30f47a70-1002-4747-a1f2-7db8abbb01be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-07bab742-98e0-4f34-8426-576539ac0d5b tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:03 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" returned: 0 in 0.798s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-quobyte-7ad011fc-78ef-47bf-9d03-ffa5fa4affda" released by "delete_volume" :: held 2.115s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Created reservations ['5a4007f1-5467-4fc8-bab3-87bfd3135b15', '3461fbbb-6c2c-4173-b5c3-48ad8de34981', '213ee2dd-46e7-49ec-975a-6beb63581e66', '93646f25-b9ed-4d72-8bab-05e8f5df4de9'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:04 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:04 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:04 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 1073741824" returned: 0 in 1.127s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:04 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8
Jul 06 13:34:04 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:05 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.841s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Deleted volume successfully.
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bc12bc37-b7d1-49c7-9ae6-4bc17acd7cd6 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-7ad011fc-78ef-47bf-9d03-ffa5fa4affda-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:05 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-694586402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e80c727-e1c0-4147-a819-f9e9e4a61c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:02Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume 9e80c727-e1c0-4147-a819-f9e9e4a61c19 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:05 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:05 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 1073741824
Jul 06 13:34:05 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (873f047f-eeff-48cf-9d70-069a8e9be3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85cf239-3171-45c4-a5f2-a270188eda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 (fa44752f-b8de-4e1b-b7ea-1360b6b38bc8): created successfully
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85cf239-3171-45c4-a5f2-a270188eda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (c71cd6de-386b-44a7-93f6-9893f586ee0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0565412a-24f6-4133-b6f5-41d043444174 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Flow 'volume_create_manager' (b3a76be5-07c6-42ad-9126-bb0ae4ca9eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcb8506-eb3c-4e08-8735-b540680ced52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcb8506-eb3c-4e08-8735-b540680ced52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580442671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b20b3fe8a4414bb708a3278715a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:06Z,use_quota=True,user_id='8bb11934883b4817a943f9440d4d6e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f89d7a9-e4ef-4fe5-a6fb-8628ee1239c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f89d7a9-e4ef-4fe5-a6fb-8628ee1239c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d5bc46-2de9-494e-9e9e-4e1a4264e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d5bc46-2de9-494e-9e9e-4e1a4264e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee', 'volume_name': 'volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05a719d-9d37-46a2-9213-f8652494f114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05a719d-9d37-46a2-9213-f8652494f114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3080f68-03ec-40a6-8fb7-c394e1187d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Volume 06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee', 'volume_size': 1}
Jul 06 13:34:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:06 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 1073741824" returned: 0 in 0.909s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:06 devstack sudo[103158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19
Jul 06 13:34:06 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:07 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.914s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1761108911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005fd82a-660e-4900-a3e4-f3cac8a3827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:03Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume 005fd82a-660e-4900-a3e4-f3cac8a3827a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:07 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:07 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a 1073741824
Jul 06 13:34:07 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c4a7b7-b972-4d50-82a8-dacec3a0b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ee684-511f-4774-8186-a9ea22737b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 (9e80c727-e1c0-4147-a819-f9e9e4a61c19): created successfully
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29ee684-511f-4774-8186-a9ea22737b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (bbf96079-e7d6-4a16-bb84-567e83b0f1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-035aeaeb-3758-436a-a235-2cedb322c6a8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:07 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a 1073741824" returned: 0 in 0.823s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:08 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a
Jul 06 13:34:08 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:08 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.922s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-429344073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7452e-e7b4-4a9d-8bb2-911039aeab6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10983b37d38b4b6488e1f32c604d3898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:03Z,use_quota=True,user_id='830610d7a8b04a26bbef50583f1ea1c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Creating volume 03d7452e-e7b4-4a9d-8bb2-911039aeab6e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:08 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:08 devstack sudo[103170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e 1073741824
Jul 06 13:34:08 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f069fe43-a87a-45fb-8c5e-6be8c78ce7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005fd82a-660e-4900-a3e4-f3cac8a3827a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce74eec-7948-4585-886e-62004229596b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:08 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-005fd82a-660e-4900-a3e4-f3cac8a3827a (005fd82a-660e-4900-a3e4-f3cac8a3827a): created successfully
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce74eec-7948-4585-886e-62004229596b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (214caaf1-5f98-4f3d-aa64-381703dfd07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-33a25221-a930-413e-ab9b-b054d3b2f28c tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:09 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e 1073741824" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:09 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e
Jul 06 13:34:09 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:10 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" returned: 0 in 0.656s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.226s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580442671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b20b3fe8a4414bb708a3278715a6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:06Z,use_quota=True,user_id='8bb11934883b4817a943f9440d4d6e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Creating volume 06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:10 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:10 devstack sudo[103179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee 1073741824
Jul 06 13:34:10 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0fc2e1-4b3e-467c-9aac-915d88d3f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21062d17-54f0-4f90-81c3-c0db104405a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:10 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Volume volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e (03d7452e-e7b4-4a9d-8bb2-911039aeab6e): created successfully
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21062d17-54f0-4f90-81c3-c0db104405a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Flow 'volume_create_manager' (eceb9905-bce9-4e3d-86a4-5d5812c12dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f673b3a6-a96a-4f2b-8b37-ae194dcefd35 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created volume successfully.
Jul 06 13:34:10 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee 1073741824" returned: 0 in 0.840s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:11 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee
Jul 06 13:34:11 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-03d7452e-e7b4-4a9d-8bb2-911039aeab6e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-03d7452e-e7b4-4a9d-8bb2-911039aeab6e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3486ec12-a791-4ba2-8139-96070630830b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:11 devstack sudo[103187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e
Jul 06 13:34:11 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:11 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" returned: 0 in 0.706s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3080f68-03ec-40a6-8fb7-c394e1187d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feccce73-e427-4c8b-9901-ca1e84d8aa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Volume volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee (06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee): created successfully
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feccce73-e427-4c8b-9901-ca1e84d8aa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Flow 'volume_create_manager' (b3a76be5-07c6-42ad-9126-bb0ae4ca9eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-51efa7bf-e1c1-494f-a9f2-74010b2ad003 tempest-VolumesTransfersV357Test-1111949858 None] Created volume successfully.
Jul 06 13:34:12 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" returned: 0 in 0.819s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:12 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e
Jul 06 13:34:12 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "cinder-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "cinder-quobyte-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-quobyte-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fffa0fd-08e2-4bf4-a8f9-aec578b72f6a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:12 devstack sudo[103231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee
Jul 06 13:34:12 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:12 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" returned: 0 in 0.677s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-03d7452e-e7b4-4a9d-8bb2-911039aeab6e" released by "delete_volume" :: held 1.533s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:12 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['3b71778d-1596-481f-ab62-82830ad68311', '22c879d6-bf7c-43a8-8c82-15781d161aea', 'fbf668ef-231f-4db1-a4c2-78278331bd23', '6721348f-014d-4d16-bcf0-5fcc4ab12a3f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:13 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:13 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:13 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" returned: 0 in 0.796s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:13 devstack sudo[103240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee
Jul 06 13:34:13 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-005fd82a-660e-4900-a3e4-f3cac8a3827a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-005fd82a-660e-4900-a3e4-f3cac8a3827a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-005fd82a-660e-4900-a3e4-f3cac8a3827a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-005fd82a-660e-4900-a3e4-f3cac8a3827a" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c417e3e-3715-46c9-a4c1-eb6e8989db17]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:13 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.723s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:13 devstack sudo[103243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2e9b4dfd-18c8-41c0-b32f-8786faf07937 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-03d7452e-e7b4-4a9d-8bb2-911039aeab6e-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:13 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:13 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" returned: 0 in 0.700s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-quobyte-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee" released by "delete_volume" :: held 1.533s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Created reservations ['145a58f1-4ce7-451c-8990-3ee5020c7899', '67d1fd5f-23a6-45bc-ac56-a47ef4691bb9', '128c3e67-1480-4639-b6f5-ce32b27fa4e8', 'd53e42b0-bf52-43e9-8bfd-443406ef8ad9'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:14 devstack sudo[103246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:14 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:14 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a" returned: 0 in 0.786s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:14 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a
Jul 06 13:34:14 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:14 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.709s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Deleted volume successfully.
Jul 06 13:34:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-65039784-92c5-45da-af4b-3f291fd8ccc3 tempest-VolumesTransfersV357Test-344509028 None] Lock "cinder-06d3cb3f-635c-4888-b3c5-9e6c8f0c1aee-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:15 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-005fd82a-660e-4900-a3e4-f3cac8a3827a" returned: 0 in 0.688s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-005fd82a-660e-4900-a3e4-f3cac8a3827a" released by "delete_volume" :: held 1.520s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['05d0cb30-6180-47c7-a859-85e6c7a60a17', 'd9df8862-8bb3-4d3e-abad-d3d08b3c36a4', '8ee067e1-c4e5-4851-b6e0-0e14246c6287', '41ce52b5-290f-425c-9fdf-7b8176013607'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:15 devstack sudo[103255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:15 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-9e80c727-e1c0-4147-a819-f9e9e4a61c19-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-9e80c727-e1c0-4147-a819-f9e9e4a61c19-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-9e80c727-e1c0-4147-a819-f9e9e4a61c19" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-9e80c727-e1c0-4147-a819-f9e9e4a61c19" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f217433c-e8d4-4e8d-ac85-04394a3c31eb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:16 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.725s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-520b37db-f490-413f-b73b-ecb364d1df6e tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-005fd82a-660e-4900-a3e4-f3cac8a3827a-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:16 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19
Jul 06 13:34:16 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:16 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19" returned: 0 in 0.898s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:16 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19
Jul 06 13:34:16 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:17 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9e80c727-e1c0-4147-a819-f9e9e4a61c19" returned: 0 in 0.658s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-9e80c727-e1c0-4147-a819-f9e9e4a61c19" released by "delete_volume" :: held 1.607s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['e27738f4-dce3-458d-a428-f15c0555a27b', '66976113-770a-4f81-8b2a-08a95b85ae43', 'bd22bb98-a9c4-4f74-8cfe-941243052d94', 'b54665f0-f059-44e0-8d88-46ea529ba67b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:17 devstack sudo[103266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:17 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b92e32-5b78-41a6-9f04-8b8192a0bd5b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:18 devstack sudo[103274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8
Jul 06 13:34:18 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:18 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.722s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:18 devstack sudo[103277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:18 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9469a966-72e6-4239-9b61-c310aa62fbf8 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-9e80c727-e1c0-4147-a819-f9e9e4a61c19-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:19 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" returned: 0 in 0.886s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:19 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:34:19 devstack sudo[103283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8
Jul 06 13:34:19 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:19 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" returned: 0 in 0.681s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8" released by "delete_volume" :: held 1.617s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['fd731135-4f46-46e2-9b40-6d2b20f3d98b', '20e5ef4a-1954-422e-a320-4aebcece7fc2', '90e6791b-7659-4b0e-8d5e-f5cb63bb1914', '93a45cf7-898d-4c76-8a1a-7ed0b6f099dd'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:19 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:19 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-37c5a233-d268-41f4-a1a0-7d4fe74f4764-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-37c5a233-d268-41f4-a1a0-7d4fe74f4764-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-37c5a233-d268-41f4-a1a0-7d4fe74f4764" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-37c5a233-d268-41f4-a1a0-7d4fe74f4764" acquired by "delete_volume" :: waited 0.026s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aca6dac-5212-4889-9b1a-f53ab3560c2f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:20 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.680s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:20 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764
Jul 06 13:34:20 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3a370cf5-e0b4-45eb-b3fd-e21eb0e7ceea tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-fa44752f-b8de-4e1b-b7ea-1360b6b38bc8-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:21 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764" returned: 0 in 0.856s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:21 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764
Jul 06 13:34:21 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:22 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-37c5a233-d268-41f4-a1a0-7d4fe74f4764" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-37c5a233-d268-41f4-a1a0-7d4fe74f4764" released by "delete_volume" :: held 1.616s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:INSERT=51,cinder:SELECT=153,cinder:UPDATE=219,cinder:DELETE=20 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['c8df4221-b69c-4816-8afd-a046987aa4de', 'd31b1ffc-1507-46c3-8316-d798682149a1', 'fb106d0d-ffee-40af-b231-f20dba478ad3', '0effd953-7556-4bba-8702-e5648ba213d5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:22 devstack sudo[103297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:22 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-c4f4c6f1-c24e-4773-abd6-320914fb1559-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-c4f4c6f1-c24e-4773-abd6-320914fb1559-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=150,cinder:UPDATE=241,cinder:INSERT=61,cinder:DELETE=21 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "cinder-quobyte-c4f4c6f1-c24e-4773-abd6-320914fb1559" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-c4f4c6f1-c24e-4773-abd6-320914fb1559" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaee391-1938-4284-9c5b-5994d565529e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:22 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559
Jul 06 13:34:22 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:23 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.768s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:23 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7871ad6f-0feb-4a66-9f35-fa029bd7d260 tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-37c5a233-d268-41f4-a1a0-7d4fe74f4764-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:23 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559" returned: 0 in 0.827s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:23 devstack sudo[103306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559
Jul 06 13:34:23 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:24 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c4f4c6f1-c24e-4773-abd6-320914fb1559" returned: 0 in 0.634s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-quobyte-c4f4c6f1-c24e-4773-abd6-320914fb1559" released by "delete_volume" :: held 1.507s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Created reservations ['cbdc05a2-ab02-42b7-b349-ba49dde2f45e', 'd18fb4df-7013-49cb-8eef-c23091a56f41', 'c2d8da4b-644a-4f0b-9067-9d958461e01f', '430e1edb-7f8b-4a52-ad28-aba63796a6ef'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:24 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:24 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:25 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.784s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:25 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Deleted volume successfully.
Jul 06 13:34:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-39267d83-607d-4849-b7a9-6979902598cd tempest-CreateVolumesFromSourceVolumeTest-1052166803 None] Lock "cinder-c4f4c6f1-c24e-4773-abd6-320914fb1559-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Flow 'volume_create_manager' (706ae164-5a4e-4b8b-adfe-42c609472c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadc0afe-2dd1-4e9c-a0e2-a8e2650944c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadc0afe-2dd1-4e9c-a0e2-a8e2650944c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298082900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2ae16-9f10-41dc-bbfd-e0e661440319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8486b475873a4e57abe514f7d076394e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:28Z,use_quota=True,user_id='4975bfe4608141a48f4d200e96ba059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe0d075-2071-467d-a86d-14c78a6c00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe0d075-2071-467d-a86d-14c78a6c00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2e812-ec3a-4776-9a53-a419bf3d1f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e2e812-ec3a-4776-9a53-a419bf3d1f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb2ae16-9f10-41dc-bbfd-e0e661440319', 'volume_name': 'volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975ae643-25d8-42dd-813b-a7966c9f4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975ae643-25d8-42dd-813b-a7966c9f4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22010c1b-ad41-406d-8411-43f666b0612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Volume fcb2ae16-9f10-41dc-bbfd-e0e661440319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319', 'volume_size': 1}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298082900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb2ae16-9f10-41dc-bbfd-e0e661440319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8486b475873a4e57abe514f7d076394e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:28Z,use_quota=True,user_id='4975bfe4608141a48f4d200e96ba059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Creating volume fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:28 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:28 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 1073741824
Jul 06 13:34:28 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:28 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 1073741824" returned: 0 in 0.921s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:29 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:29 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:29 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.691s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22010c1b-ad41-406d-8411-43f666b0612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b96bc31-d1f2-4ccb-8733-a8b3f8258894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Volume volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 (fcb2ae16-9f10-41dc-bbfd-e0e661440319): created successfully
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b96bc31-d1f2-4ccb-8733-a8b3f8258894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Flow 'volume_create_manager' (706ae164-5a4e-4b8b-adfe-42c609472c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a19ab870-401e-434b-9a8f-56dd6f9651f8 tempest-VolumeDependencyTests-133985011 None] Created volume successfully.
Jul 06 13:34:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Creating offline snapshot 972f554a-c889-4133-b7e7-b9d469137ce6 of volume fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:34:30 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d7537-f582-47a8-8543-764b79e48f8e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:30 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:30 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:31 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.846s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:31 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 1G
Jul 06 13:34:31 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Flow 'volume_create_manager' (f34084ea-5626-4428-b07d-f99aefd8add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa9f742-fb18-4004-b2b2-63fb4c29b2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa9f742-fb18-4004-b2b2-63fb4c29b2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762055331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25decf-39b5-4be5-8bf3-9b5d0e744ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765c120c30e448d2b1da926e781ecafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:31Z,use_quota=True,user_id='e65616062e5d46779f64000bc0c21251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4378858-b2cb-4478-bc45-2fcdd9fd727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4378858-b2cb-4478-bc45-2fcdd9fd727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d10a978-1850-4f30-a5a2-9dcce4975d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d10a978-1850-4f30-a5a2-9dcce4975d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c25decf-39b5-4be5-8bf3-9b5d0e744ddc', 'volume_name': 'volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8adab0-4999-41e6-92ee-c702759cfaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8adab0-4999-41e6-92ee-c702759cfaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cf74f-ab7e-4df6-805a-4ee2b2865a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:31 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc', 'volume_size': 1}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:31 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 1G" returned: 0 in 0.776s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:31 devstack sudo[103334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:31 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:32 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.681s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:32 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 is being set with open permissions: ugo+rw
Jul 06 13:34:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:32 devstack sudo[103339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:32 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:33 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.613s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:33 devstack sudo[103343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info
Jul 06 13:34:33 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:33 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info" returned: 0 in 0.611s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:33 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info is being set with open permissions: ugo+rw
Jul 06 13:34:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:33 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info
Jul 06 13:34:33 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:34 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.info" returned: 0 in 0.623s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.205s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-762055331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25decf-39b5-4be5-8bf3-9b5d0e744ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765c120c30e448d2b1da926e781ecafb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:31Z,use_quota=True,user_id='e65616062e5d46779f64000bc0c21251',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Creating volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:34 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:34:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:34 devstack sudo[103350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc 1073741824
Jul 06 13:34:34 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cf43e75e-5a4b-4350-a50c-692d8922a70a tempest-VolumeDependencyTests-133985011 None] Create snapshot completed successfully
Jul 06 13:34:35 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc 1073741824" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:35 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:34:35 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Flow 'volume_create_manager' (1349e254-3c6b-4aef-9ded-c54c37d7a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed9fec6-785e-4ba4-8c81-d767f389c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed9fec6-785e-4ba4-8c81-d767f389c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1642225302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7d7f91-3dcd-4953-9e3a-cbf68519348b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8486b475873a4e57abe514f7d076394e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=972f554a-c889-4133-b7e7-b9d469137ce6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:34:36Z,use_quota=True,user_id='4975bfe4608141a48f4d200e96ba059e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a76a5f-ba46-4316-9dc4-714038daef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a76a5f-ba46-4316-9dc4-714038daef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d5ef3-bc85-4a9f-bf02-53ef8a1a41b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090d5ef3-bc85-4a9f-bf02-53ef8a1a41b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c7d7f91-3dcd-4953-9e3a-cbf68519348b', 'volume_name': 'volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b', 'volume_size': 1, 'snapshot_id': '972f554a-c889-4133-b7e7-b9d469137ce6'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac90220-91b3-4ed0-b22d-4f1b1e96397c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac90220-91b3-4ed0-b22d-4f1b1e96397c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a00cae-4d9a-4f25-822d-470ff5be3288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Volume 6c7d7f91-3dcd-4953-9e3a-cbf68519348b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b', 'volume_size': 1, 'snapshot_id': '972f554a-c889-4133-b7e7-b9d469137ce6'}
Jul 06 13:34:36 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.708s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505cf74f-ab7e-4df6-805a-4ee2b2865a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15345ae-11c9-409f-8173-6134cf006393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Creating volume 6c7d7f91-3dcd-4953-9e3a-cbf68519348b from snapshot 972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] snapshot: 972f554a-c889-4133-b7e7-b9d469137ce6, volume: 6c7d7f91-3dcd-4953-9e3a-cbf68519348b,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:34:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Volume volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc (6c25decf-39b5-4be5-8bf3-9b5d0e744ddc): created successfully
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15345ae-11c9-409f-8173-6134cf006393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Flow 'volume_create_manager' (f34084ea-5626-4428-b07d-f99aefd8add1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-beaa5833-be22-470e-8679-b8fc536a2b10 tempest-VolumesActionsTest-1684220049 None] Created volume successfully.
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f24389-318d-4c55-8579-556282a4a423]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:36 devstack sudo[103358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:36 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:37 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.808s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c659d8d-ab52-4c11-9b6a-ba8f131988d8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:37 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:37 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:37 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.779s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:34:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:37 devstack sudo[103371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b
Jul 06 13:34:37 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:42 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" returned: 0 in 4.964s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a77c3-8219-4aaf-a384-27fdcb57702e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:42 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:42 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:43 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.979s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:43 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:34:43 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Converted 1024.00 MB image at 206.25 MB/s
Jul 06 13:34:43 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b is being set with open permissions: ugo+rw
Jul 06 13:34:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:43 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b
Jul 06 13:34:43 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:44 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" returned: 0 in 0.768s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" released by "_copy_volume_from_snapshot" :: held 8.426s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" released by "_create_volume_from_snapshot" :: held 8.457s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.485s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a00cae-4d9a-4f25-822d-470ff5be3288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b', 'volume_size': 1, 'snapshot_id': '972f554a-c889-4133-b7e7-b9d469137ce6'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82725b9-3bad-485f-8330-5cec6a044448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:34:44 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Volume volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b (6c7d7f91-3dcd-4953-9e3a-cbf68519348b): created successfully
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82725b9-3bad-485f-8330-5cec6a044448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Flow 'volume_create_manager' (1349e254-3c6b-4aef-9ded-c54c37d7a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:34:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8931d71b-f8f0-4d97-b366-c26cc638bbd8 tempest-VolumeDependencyTests-133985011 None] Created volume successfully.
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-972f554a-c889-4133-b7e7-b9d469137ce6-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-972f554a-c889-4133-b7e7-b9d469137ce6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Deleting offline snapshot 972f554a-c889-4133-b7e7-b9d469137ce6 of volume fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] snapshot_file for this snap is: volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf239ac-456f-4e96-a569-2bee3c83c791]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:45 devstack sudo[103408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:45 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:45 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.789s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:34:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3df206-f691-4c55-aeef-e228be63b658]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:45 devstack sudo[103415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:45 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:46 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:46 devstack sudo[103420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:46 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:47 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.811s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:47 devstack sudo[103425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6
Jul 06 13:34:47 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:48 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319.972f554a-c889-4133-b7e7-b9d469137ce6" returned: 0 in 0.800s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-972f554a-c889-4133-b7e7-b9d469137ce6" released by "_delete_snapshot" :: held 3.304s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" released by "delete_snapshot" :: held 3.330s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Created reservations ['bfba088a-3f2b-45c1-81d9-babc9bf3ba84', 'c4863677-3afb-4ec5-b8dd-89c465d36d86', '697a88b6-d5f8-4bd7-a7d5-5185c83a155b', '2b0d9973-36c0-43b0-933e-5ec92c656696'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Delete snapshot completed successfully.
Jul 06 13:34:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-885bd74e-beb3-4661-8d32-381fa60496d5 tempest-VolumeDependencyTests-133985011 None] Lock "cinder-972f554a-c889-4133-b7e7-b9d469137ce6-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-fcb2ae16-9f10-41dc-bbfd-e0e661440319-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "cinder-fcb2ae16-9f10-41dc-bbfd-e0e661440319-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8afecc2-76ac-43db-b8ce-61e3b24a231a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:49 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:49 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:50 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.804s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:50 devstack sudo[103498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319
Jul 06 13:34:50 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:50 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-fcb2ae16-9f10-41dc-bbfd-e0e661440319" returned: 0 in 0.676s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-fcb2ae16-9f10-41dc-bbfd-e0e661440319" released by "delete_volume" :: held 1.543s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Created reservations ['81744a25-caac-4bf9-bafc-408d62841567', 'f9982bb7-fd10-42f4-a1ae-fbe3b2d685f6', '1a6f8a6e-58cf-4cb3-bf70-98504f321c62', '86665e7d-b8f1-478b-9f6f-4ca5b2466fde'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:50 devstack sudo[103503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:50 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-6c7d7f91-3dcd-4953-9e3a-cbf68519348b-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "cinder-6c7d7f91-3dcd-4953-9e3a-cbf68519348b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Acquiring lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d2975-d7ca-439d-a419-6368c95e5262]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:51 devstack sudo[103506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b
Jul 06 13:34:51 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:51 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.962s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Deleted volume successfully.
Jul 06 13:34:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87e49996-83a4-496a-ac89-8db6e27a6fdb tempest-VolumeDependencyTests-133985011 None] Lock "cinder-fcb2ae16-9f10-41dc-bbfd-e0e661440319-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:52 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" returned: 0 in 0.892s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:52 devstack sudo[103512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b
Jul 06 13:34:52 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6328d52d-a529-421e-8ae6-931cca286684 tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" by "attach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6328d52d-a529-421e-8ae6-931cca286684 tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" acquired by "attach_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6328d52d-a529-421e-8ae6-931cca286684 tempest-VolumesActionsTest-1684220049 None] Attaching volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc to instance ea062cf5-62e7-433c-8440-d7056d808645 at mountpoint /dev/vdb on host None.
Jul 06 13:34:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6328d52d-a529-421e-8ae6-931cca286684 tempest-VolumesActionsTest-1684220049 None] Attach volume completed successfully.
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6328d52d-a529-421e-8ae6-931cca286684 tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" released by "attach_volume" :: held 0.114s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:53 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "cinder-quobyte-6c7d7f91-3dcd-4953-9e3a-cbf68519348b" released by "delete_volume" :: held 1.686s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Created reservations ['9b89cf1b-794c-4fb7-9a3d-f1f9cedf3848', '4ea596ac-822c-45e5-9212-2cf5172bd518', '505440ee-a3ab-4112-9ccd-06a6382be40e', '5bc45f7d-2227-41bb-85c8-0665655390e8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:34:53 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:34:53 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a493519-6a49-4984-8bc3-36109792330c tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" by "detach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a493519-6a49-4984-8bc3-36109792330c tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:34:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9a493519-6a49-4984-8bc3-36109792330c tempest-VolumesActionsTest-1684220049 None] Detaching volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc from instance ea062cf5-62e7-433c-8440-d7056d808645.
Jul 06 13:34:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9a493519-6a49-4984-8bc3-36109792330c tempest-VolumesActionsTest-1684220049 None] Detach volume completed successfully.
Jul 06 13:34:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9a493519-6a49-4984-8bc3-36109792330c tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:34:54 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Jul 06 13:34:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.826s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:34:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:34:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Deleted volume successfully.
Jul 06 13:34:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8e517afd-d6bd-42e1-a833-3ee0ed5a8eea tempest-VolumeDependencyTests-133985011 None] Lock "cinder-6c7d7f91-3dcd-4953-9e3a-cbf68519348b-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (02a06492-a5d3-4c6c-93b1-a3d7211e09c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a283964-2cc4-4e5b-9225-913d224e0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a283964-2cc4-4e5b-9225-913d224e0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31596560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f372ace-7132-4f5b-844c-1e7ce3f6aff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:02Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad16419-2efd-4a10-aa5b-663591f16c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad16419-2efd-4a10-aa5b-663591f16c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a355ecc-4c05-49fd-a429-d6f3ba55bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a355ecc-4c05-49fd-a429-d6f3ba55bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f372ace-7132-4f5b-844c-1e7ce3f6aff5', 'volume_name': 'volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3276456-4e13-4b2d-902e-62eb0d1ec379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3276456-4e13-4b2d-902e-62eb0d1ec379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333e9d6b-c556-4d57-a63c-8e23d1bb1a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Volume 2f372ace-7132-4f5b-844c-1e7ce3f6aff5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5', 'volume_size': 1}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-31596560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f372ace-7132-4f5b-844c-1e7ce3f6aff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:02Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Creating volume 2f372ace-7132-4f5b-844c-1e7ce3f6aff5 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:35:02 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:35:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:02 devstack sudo[103545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 1073741824
Jul 06 13:35:02 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:03 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 1073741824" returned: 0 in 0.906s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:03 devstack sudo[103555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5
Jul 06 13:35:03 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:04 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" returned: 0 in 0.683s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333e9d6b-c556-4d57-a63c-8e23d1bb1a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa4099-cdef-4460-a7f6-6a328acb987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:04 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Volume volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 (2f372ace-7132-4f5b-844c-1e7ce3f6aff5): created successfully
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafa4099-cdef-4460-a7f6-6a328acb987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (02a06492-a5d3-4c6c-93b1-a3d7211e09c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-57b380ba-d9b1-4da6-8a9d-2e6ba93cdfa1 tempest-ProjectReaderTests-620534768 None] Created volume successfully.
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-2f372ace-7132-4f5b-844c-1e7ce3f6aff5-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "cinder-2f372ace-7132-4f5b-844c-1e7ce3f6aff5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-quobyte-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa6e9e6-aee0-4329-900e-33899e9562c8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:04 devstack sudo[103558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5
Jul 06 13:35:04 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:05 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:05 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5
Jul 06 13:35:05 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:06 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" returned: 0 in 0.658s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-2f372ace-7132-4f5b-844c-1e7ce3f6aff5" released by "delete_volume" :: held 1.422s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Created reservations ['0a02041c-76a0-48ec-b7e4-3005745b50fc', 'a3f74e76-11e3-4fb8-83e6-a24fe30849e3', '96e504f6-cd9e-4d98-87c4-86ab51e7c7c5', '68abd2db-3d65-4c5a-b6e4-1ae9704cbbd8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:06 devstack sudo[103566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:35:06 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:06 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.626s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:35:06 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Deleted volume successfully.
Jul 06 13:35:06 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2de783dc-ffe8-4522-b833-e8e4fce5a680 tempest-ProjectReaderTests-620534768 None] Lock "cinder-2f372ace-7132-4f5b-844c-1e7ce3f6aff5-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (cf77a4a4-6f93-4660-befa-cda9300100d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a083c4c-4681-49e0-8f2d-b0d321fd961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a083c4c-4681-49e0-8f2d-b0d321fd961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392246147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7885d0ee-ea43-4eda-8bd9-b99d9fe7c990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:07Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ce28a6-c5d2-471e-9f4a-df107f541504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5ce28a6-c5d2-471e-9f4a-df107f541504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd477c0-8e3f-4f9d-9afd-5df5db33f41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd477c0-8e3f-4f9d-9afd-5df5db33f41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7885d0ee-ea43-4eda-8bd9-b99d9fe7c990', 'volume_name': 'volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a15112-cdb0-412a-9d41-098b87d60c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a15112-cdb0-412a-9d41-098b87d60c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f054be4-e27a-4e4e-aae9-c32a20b8edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Volume 7885d0ee-ea43-4eda-8bd9-b99d9fe7c990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990', 'volume_size': 1}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392246147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7885d0ee-ea43-4eda-8bd9-b99d9fe7c990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:07Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Creating volume 7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:35:07 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:35:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:07 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 1073741824
Jul 06 13:35:07 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:08 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 1073741824" returned: 0 in 0.974s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:08 devstack sudo[103577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990
Jul 06 13:35:08 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:09 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f054be4-e27a-4e4e-aae9-c32a20b8edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f6952-ccd6-40e4-ab5b-733d17f5a6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Volume volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 (7885d0ee-ea43-4eda-8bd9-b99d9fe7c990): created successfully
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87f6952-ccd6-40e4-ab5b-733d17f5a6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (cf77a4a4-6f93-4660-befa-cda9300100d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8b49f98b-6b4b-4a92-bb92-fee571f8515c tempest-ProjectReaderTests-620534768 None] Created volume successfully.
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "cinder-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-quobyte-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc37d4a-b8c9-44ab-adec-8b985f620c75]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:10 devstack sudo[103596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990
Jul 06 13:35:10 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:10 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" returned: 0 in 0.746s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:10 devstack sudo[103601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990
Jul 06 13:35:10 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:11 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" returned: 0 in 0.652s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990" released by "delete_volume" :: held 1.452s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Created reservations ['572d5100-b564-4a3c-ad04-deda885bde9a', 'f31ef38d-21b9-4676-8649-83aa692740fb', 'c0e578b2-4d67-43c5-b058-c2f4d8d332b0', '4af7ac9c-8a38-4c41-af7b-1a311e2820a7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:11 devstack sudo[103604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:35:11 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:12 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.760s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:35:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Deleted volume successfully.
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f145d031-c583-4067-857e-012efadae68a tempest-ProjectReaderTests-620534768 None] Lock "cinder-7885d0ee-ea43-4eda-8bd9-b99d9fe7c990-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (2fa18498-9b5a-4a31-b2a9-bce1f142b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840a42e-7388-471d-a879-bb9445383517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7840a42e-7388-471d-a879-bb9445383517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564153981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6807859-ea6e-4098-aaff-79ec797b8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:12Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffaa7dc-7484-43e2-b0a9-236bea219ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffaa7dc-7484-43e2-b0a9-236bea219ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f2a99-cb6d-49e2-87cc-8b05a170ce55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f2a99-cb6d-49e2-87cc-8b05a170ce55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6807859-ea6e-4098-aaff-79ec797b8c51', 'volume_name': 'volume-f6807859-ea6e-4098-aaff-79ec797b8c51', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a506fa-f4f7-4cf8-a2f7-b51687031efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a506fa-f4f7-4cf8-a2f7-b51687031efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81b66f-a15c-4a95-8aec-325544d503d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:12 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Volume f6807859-ea6e-4098-aaff-79ec797b8c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6807859-ea6e-4098-aaff-79ec797b8c51', 'volume_size': 1}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564153981',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6807859-ea6e-4098-aaff-79ec797b8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:12Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Creating volume f6807859-ea6e-4098-aaff-79ec797b8c51 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:35:12 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:35:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:12 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 1073741824
Jul 06 13:35:12 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:13 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 1073741824" returned: 0 in 1.085s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:13 devstack sudo[103695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51
Jul 06 13:35:13 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:14 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51" returned: 0 in 0.648s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e81b66f-a15c-4a95-8aec-325544d503d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6807859-ea6e-4098-aaff-79ec797b8c51', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd67577-0fab-4687-abc5-e7ab9baab6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:14 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Volume volume-f6807859-ea6e-4098-aaff-79ec797b8c51 (f6807859-ea6e-4098-aaff-79ec797b8c51): created successfully
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dd67577-0fab-4687-abc5-e7ab9baab6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (2fa18498-9b5a-4a31-b2a9-bce1f142b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4810df49-8f03-462b-af99-68acfe0e867e tempest-ProjectReaderTests-620534768 None] Created volume successfully.
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-f6807859-ea6e-4098-aaff-79ec797b8c51-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "cinder-f6807859-ea6e-4098-aaff-79ec797b8c51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-quobyte-f6807859-ea6e-4098-aaff-79ec797b8c51" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-f6807859-ea6e-4098-aaff-79ec797b8c51" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496ae83-3b44-45f9-9913-fca113b65448]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:14 devstack sudo[103717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51
Jul 06 13:35:14 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:15 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51" returned: 0 in 0.765s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:15 devstack sudo[103724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51
Jul 06 13:35:15 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:16 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f6807859-ea6e-4098-aaff-79ec797b8c51" returned: 0 in 0.703s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-f6807859-ea6e-4098-aaff-79ec797b8c51" released by "delete_volume" :: held 1.513s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Created reservations ['eb6ca927-2a66-45cb-baba-b1993b74dbdd', 'ab5405e1-4018-43ae-a025-99217b77d6fb', '668869e1-cd72-4a55-9732-6602b87c4aa4', 'ad8f0c12-ed53-4666-8a55-22ed4d440f84'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:16 devstack sudo[103727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:35:16 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:17 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.701s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:35:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Deleted volume successfully.
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eca9a3d1-58a2-4ddb-82cb-48ae8b09c81d tempest-ProjectReaderTests-620534768 None] Lock "cinder-f6807859-ea6e-4098-aaff-79ec797b8c51-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (5ff67e5e-5922-4ef8-95d9-1e6c6ac898f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31521de-7bc4-49c2-82e1-648051410a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a31521de-7bc4-49c2-82e1-648051410a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389937495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4d71b-c9b3-4eca-9f67-be649703ecac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:17Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b816e7e5-1c92-41a4-ab72-6ff820039f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b816e7e5-1c92-41a4-ab72-6ff820039f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36942105-67c7-4346-931c-838eeb73bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36942105-67c7-4346-931c-838eeb73bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f4d71b-c9b3-4eca-9f67-be649703ecac', 'volume_name': 'volume-15f4d71b-c9b3-4eca-9f67-be649703ecac', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24aa1d5-1c27-4393-b595-36f8f2317981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24aa1d5-1c27-4393-b595-36f8f2317981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb7f911-3fdd-4f55-b1f8-74b64612a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:17 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Volume 15f4d71b-c9b3-4eca-9f67-be649703ecac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f4d71b-c9b3-4eca-9f67-be649703ecac', 'volume_size': 1}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-389937495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f4d71b-c9b3-4eca-9f67-be649703ecac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7219fc2049842cf87bab060b72a0686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:17Z,use_quota=True,user_id='0024b964f1414a37b95ccd295079de29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Creating volume 15f4d71b-c9b3-4eca-9f67-be649703ecac {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:35:17 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8a9ea92b-7e4d-4f7f-a385-b9e09d1c34ee tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" by "attach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:17 devstack sudo[103730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac 1073741824
Jul 06 13:35:17 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8a9ea92b-7e4d-4f7f-a385-b9e09d1c34ee tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" acquired by "attach_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8a9ea92b-7e4d-4f7f-a385-b9e09d1c34ee tempest-VolumesActionsTest-1684220049 None] Attaching volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc to instance 526e5348-afd3-435e-ab45-8f4be84504c2 at mountpoint /dev/vdb on host None.
Jul 06 13:35:17 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8a9ea92b-7e4d-4f7f-a385-b9e09d1c34ee tempest-VolumesActionsTest-1684220049 None] Attach volume completed successfully.
Jul 06 13:35:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8a9ea92b-7e4d-4f7f-a385-b9e09d1c34ee tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" released by "attach_volume" :: held 0.093s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48e9a4e3-e582-4fb9-9022-8b8430c6da9d tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" by "detach_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48e9a4e3-e582-4fb9-9022-8b8430c6da9d tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-48e9a4e3-e582-4fb9-9022-8b8430c6da9d tempest-VolumesActionsTest-1684220049 None] Detaching volume 6c25decf-39b5-4be5-8bf3-9b5d0e744ddc from instance 526e5348-afd3-435e-ab45-8f4be84504c2.
Jul 06 13:35:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-48e9a4e3-e582-4fb9-9022-8b8430c6da9d tempest-VolumesActionsTest-1684220049 None] Detach volume completed successfully.
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-48e9a4e3-e582-4fb9-9022-8b8430c6da9d tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-detach_volume" released by "detach_volume" :: held 0.062s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:18 devstack sudo[103742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:35:18 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:18 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac 1073741824" returned: 0 in 0.896s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:18 devstack sudo[103744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac
Jul 06 13:35:18 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:19 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.702s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:35:19 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac" returned: 0 in 0.760s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb7f911-3fdd-4f55-b1f8-74b64612a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f4d71b-c9b3-4eca-9f67-be649703ecac', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b622644-e099-4ac6-aa3c-ab0827931585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:19 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Volume volume-15f4d71b-c9b3-4eca-9f67-be649703ecac (15f4d71b-c9b3-4eca-9f67-be649703ecac): created successfully
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b622644-e099-4ac6-aa3c-ab0827931585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Flow 'volume_create_manager' (5ff67e5e-5922-4ef8-95d9-1e6c6ac898f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c634c4ae-09dd-45dc-b08b-9e5c831e1e42 tempest-ProjectReaderTests-620534768 None] Created volume successfully.
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-15f4d71b-c9b3-4eca-9f67-be649703ecac-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "cinder-15f4d71b-c9b3-4eca-9f67-be649703ecac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Acquiring lock "cinder-quobyte-15f4d71b-c9b3-4eca-9f67-be649703ecac" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-15f4d71b-c9b3-4eca-9f67-be649703ecac" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559c634-272b-450e-aa52-313252a1f977]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:19 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac
Jul 06 13:35:19 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:20 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac" returned: 0 in 0.739s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:20 devstack sudo[103758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac
Jul 06 13:35:20 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:21 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-15f4d71b-c9b3-4eca-9f67-be649703ecac" returned: 0 in 0.732s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "cinder-quobyte-15f4d71b-c9b3-4eca-9f67-be649703ecac" released by "delete_volume" :: held 1.511s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Created reservations ['ec287028-a9ea-4ca0-bc87-a3f86e7166f8', '8c6f5aab-5c5d-419f-99e7-1b94270565d8', 'a07286a7-1dfd-4471-a0bc-4205d3720495', '55b9b0e7-07bb-4b0c-8b97-c394560e6098'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:21 devstack sudo[103776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:35:21 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:22 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.735s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:22 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:35:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Deleted volume successfully.
Jul 06 13:35:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e3f47ea9-755e-48c1-9435-0e77be798d81 tempest-ProjectReaderTests-620534768 None] Lock "cinder-15f4d71b-c9b3-4eca-9f67-be649703ecac-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:35:28 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:INSERT=21,cinder:UPDATE=95,cinder:SELECT=75,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:35:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ee057b-8cce-4079-bacd-920c668ed022]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:28 devstack sudo[103784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:35:28 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:29 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.854s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[805eae86-af76-4d17-82b7-1408e9e5e8de]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:29 devstack sudo[103789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:35:29 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:29 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.774s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.4fca31f1-ffb1-41cc-a212-ab5b0f250737uwzo0yai.img {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:29 devstack sudo[103794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.4fca31f1-ffb1-41cc-a212-ab5b0f250737uwzo0yai.img
Jul 06 13:35:29 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:32 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:DELETE=10,cinder:SELECT=70,cinder:INSERT=23,cinder:UPDATE=88 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:35:35 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.4fca31f1-ffb1-41cc-a212-ab5b0f250737uwzo0yai.img" returned: 0 in 5.315s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[beaf7140-c61b-4ef8-b81d-57dfee516d3e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:35 devstack sudo[103811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:35:35 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:36 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.967s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:36 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.4fca31f1-ffb1-41cc-a212-ab5b0f250737uwzo0yai.img {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:35:36 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Converted 1024.00 MB image at 192.63 MB/s
Jul 06 13:35:36 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] 4fca31f1-ffb1-41cc-a212-ab5b0f250737 was raw, no need to convert to raw {{(pid=86698) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 06 13:35:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:35:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Flow 'volume_create_manager' (50a042c1-9904-4549-a515-b321022b64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13604353-0057-44f6-8009-9e6a20d8dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13604353-0057-44f6-8009-9e6a20d8dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-738648116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c8c6e4-304b-4909-a802-a1d920a05f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8729390e007e4a729b3f093659e9f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:49Z,use_quota=True,user_id='4854d42250494fe8a009ac47502155b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8c80df-2c7e-410c-bf91-6d7173d9ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8c80df-2c7e-410c-bf91-6d7173d9ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0a93d-e241-4eff-8e3e-39b15d34b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0df0a93d-e241-4eff-8e3e-39b15d34b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c8c6e4-304b-4909-a802-a1d920a05f00', 'volume_name': 'volume-96c8c6e4-304b-4909-a802-a1d920a05f00', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee2d807-ca65-433f-bcd1-24d1bc51f7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee2d807-ca65-433f-bcd1-24d1bc51f7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9712b5-ba70-421f-af29-e2f7d5831c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:49 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Volume 96c8c6e4-304b-4909-a802-a1d920a05f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c8c6e4-304b-4909-a802-a1d920a05f00', 'volume_size': 1}
Jul 06 13:35:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.526s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Uploaded volume to glance image-id: 4fca31f1-ffb1-41cc-a212-ab5b0f250737. {{(pid=86698) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.529s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-738648116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c8c6e4-304b-4909-a802-a1d920a05f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8729390e007e4a729b3f093659e9f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:35:49Z,use_quota=True,user_id='4854d42250494fe8a009ac47502155b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Creating volume 96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:35:56 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:35:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:56 devstack sudo[103818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 1073741824
Jul 06 13:35:56 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0b1e4faa-32fc-4211-9320-bdeed64b3cd6 tempest-VolumesActionsTest-1684220049 None] Copy volume to image completed successfully.
Jul 06 13:35:57 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 1073741824" returned: 0 in 0.860s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:57 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:35:57 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:58 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.685s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9712b5-ba70-421f-af29-e2f7d5831c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c8c6e4-304b-4909-a802-a1d920a05f00', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755b3bb-1ade-4e38-a5a5-53f26ef62de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:35:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Volume volume-96c8c6e4-304b-4909-a802-a1d920a05f00 (96c8c6e4-304b-4909-a802-a1d920a05f00): created successfully
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5755b3bb-1ade-4e38-a5a5-53f26ef62de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Flow 'volume_create_manager' (50a042c1-9904-4549-a515-b321022b64d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:35:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-815bd690-cb6b-43e1-8a15-ece8b184a528 tempest-SnapshotDependencyTests-1585397159 None] Created volume successfully.
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3158183-6219-40bb-b521-07d631c74310]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:58 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:35:58 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:35:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:35:59 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Jul 06 13:35:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.808s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:35:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[309bf76e-e5c7-4a7d-8633-cc040252eddf]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:35:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:35:59 devstack sudo[103832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:35:59 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:00 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.800s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:00 devstack sudo[103837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img
Jul 06 13:36:00 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:04 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img" returned: 0 in 4.058s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284c465-0d9d-4adb-9a84-8454d084d0ed]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:04 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:36:04 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:05 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 1.066s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:36:05 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Converted 1024.00 MB image at 252.23 MB/s
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] 97a8db85-5e19-4016-8a5c-c3e68e4485e9 was raw, converting to qcow2 {{(pid=86698) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24019c-e894-4c62-a22f-1286ed223c14]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:05 devstack sudo[103857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img
Jul 06 13:36:05 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:05 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img" returned: 0 in 0.710s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:06 devstack sudo[103861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img
Jul 06 13:36:06 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:06 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img" returned: 1 in 0.764s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:36:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img /opt/stack/data/cinder/conversion/vol_upload_l0juc36s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:06 devstack sudo[103866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img /opt/stack/data/cinder/conversion/vol_upload_l0juc36s
Jul 06 13:36:06 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:07 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img /opt/stack/data/cinder/conversion/vol_upload_l0juc36s" returned: 0 in 0.660s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:07 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Image conversion details: src /opt/stack/data/cinder/conversion/6c25decf-39b5-4be5-8bf3-9b5d0e744ddc.temp_image.97a8db85-5e19-4016-8a5c-c3e68e4485e9uu0chfkb.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l0juc36s {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:36:07 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 06 13:36:07 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4e291-b285-4891-9924-ed2afb37dd73]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l0juc36s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:07 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l0juc36s
Jul 06 13:36:07 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:08 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l0juc36s" returned: 0 in 0.666s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.918s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Uploaded volume to glance image-id: 97a8db85-5e19-4016-8a5c-c3e68e4485e9. {{(pid=86698) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.347s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Creating offline snapshot a52b3323-b4aa-426e-8129-067f4272229e of volume 96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:36:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6b50e0b0-7b68-4ceb-ad4e-6a16e42c2336 tempest-VolumesActionsTest-1684220049 None] Copy volume to image completed successfully.
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e33f01-54e6-4483-91d7-b05bcff57a0e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:09 devstack sudo[103878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:09 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:10 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.740s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:10 devstack sudo[103883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e 1G
Jul 06 13:36:10 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Acquiring lock "cinder-quobyte-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "cinder-quobyte-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70ab8a0-6302-45b9-964f-0521006133d4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:10 devstack sudo[103885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:36:10 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:10 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e 1G" returned: 0 in 0.818s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c8c6e4-304b-4909-a802-a1d920a05f00 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:10 devstack sudo[103890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c8c6e4-304b-4909-a802-a1d920a05f00 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:10 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:11 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:11 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc
Jul 06 13:36:11 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:11 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c8c6e4-304b-4909-a802-a1d920a05f00 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.695s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:11 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e is being set with open permissions: ugo+rw
Jul 06 13:36:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:11 devstack sudo[103900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:11 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:12 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" returned: 0 in 0.627s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "cinder-quobyte-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc" released by "delete_volume" :: held 1.441s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Created reservations ['4af9bef7-6972-4621-b3a6-4f2dea8fbf7d', '5cb4947b-de62-4592-a03a-b8fb89163429', '2708cce5-f34d-4a07-9f87-452378b8815d', '6e865767-7194-4064-8a88-c4021359f406'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:12 devstack sudo[103904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:36:12 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:12 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.652s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:12 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info
Jul 06 13:36:12 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:12 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.744s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:36:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Deleted volume successfully.
Jul 06 13:36:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87901790-1812-4f66-a921-92c02f04029e tempest-VolumesActionsTest-1684220049 None] Lock "cinder-6c25decf-39b5-4be5-8bf3-9b5d0e744ddc-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:13 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info" returned: 0 in 0.757s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:13 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info is being set with open permissions: ugo+rw
Jul 06 13:36:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:13 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info
Jul 06 13:36:13 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:13 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.info" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.475s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-567002c1-933f-41e8-afa5-ead92289283c tempest-SnapshotDependencyTests-1585397159 None] Create snapshot completed successfully
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Flow 'volume_create_manager' (c11eaa74-7cbf-4d07-9988-ee3f9e23b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672b1b48-dc09-45ed-a65c-d3e7c8d53793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672b1b48-dc09-45ed-a65c-d3e7c8d53793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03aabc4-a300-473c-a599-d075500d0055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8729390e007e4a729b3f093659e9f954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a52b3323-b4aa-426e-8129-067f4272229e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:36:15Z,use_quota=True,user_id='4854d42250494fe8a009ac47502155b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa93fdd3-cc3f-46c4-af3d-ef2aad778b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa93fdd3-cc3f-46c4-af3d-ef2aad778b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c78cbc6-20ac-4ba3-a683-d8318891eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c78cbc6-20ac-4ba3-a683-d8318891eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b03aabc4-a300-473c-a599-d075500d0055', 'volume_name': 'volume-b03aabc4-a300-473c-a599-d075500d0055', 'volume_size': 1, 'snapshot_id': 'a52b3323-b4aa-426e-8129-067f4272229e'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e3e48f-5f4f-4fb0-8267-962885f6cfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e3e48f-5f4f-4fb0-8267-962885f6cfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8533b8d6-d496-46cd-a598-65e69a4163df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:15 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Volume b03aabc4-a300-473c-a599-d075500d0055: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b03aabc4-a300-473c-a599-d075500d0055', 'volume_size': 1, 'snapshot_id': 'a52b3323-b4aa-426e-8129-067f4272229e'}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e-b03aabc4-a300-473c-a599-d075500d0055" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e-b03aabc4-a300-473c-a599-d075500d0055" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Creating volume b03aabc4-a300-473c-a599-d075500d0055 from snapshot a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] snapshot: a52b3323-b4aa-426e-8129-067f4272229e, volume: b03aabc4-a300-473c-a599-d075500d0055,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd400a-33d5-4b3f-95ce-995e2d1fd597]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:15 devstack sudo[103952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:15 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:16 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.854s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96c8c6e4-304b-4909-a802-a1d920a05f00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e945f94-5464-4659-ad8f-b7ea15148089]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:16 devstack sudo[103957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:16 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:17 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:17 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:36:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:17 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055
Jul 06 13:36:17 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:18 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:36:18 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:19 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.378s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:36:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:36:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:36:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:36:22 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055" returned: 0 in 5.286s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1703322c-b527-4106-9b59-a49884a37d32]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:22 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:22 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:23 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 1.044s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:23 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:36:23 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Converted 1024.00 MB image at 193.66 MB/s
Jul 06 13:36:23 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 is being set with open permissions: ugo+rw
Jul 06 13:36:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:23 devstack sudo[103992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055
Jul 06 13:36:23 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:24 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055" returned: 0 in 0.702s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" released by "_copy_volume_from_snapshot" :: held 8.806s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e-b03aabc4-a300-473c-a599-d075500d0055" released by "_create_volume_from_snapshot" :: held 8.838s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.856s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8533b8d6-d496-46cd-a598-65e69a4163df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03aabc4-a300-473c-a599-d075500d0055', 'volume_size': 1, 'snapshot_id': 'a52b3323-b4aa-426e-8129-067f4272229e'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d75377a-7411-499c-aff5-7a070e45188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Volume volume-b03aabc4-a300-473c-a599-d075500d0055 (b03aabc4-a300-473c-a599-d075500d0055): created successfully
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d75377a-7411-499c-aff5-7a070e45188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Flow 'volume_create_manager' (c11eaa74-7cbf-4d07-9988-ee3f9e23b273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:36:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9f574ce3-a95e-4a18-9dbc-c863ec1523cc tempest-SnapshotDependencyTests-1585397159 None] Created volume successfully.
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Flow 'volume_create_manager' (98601ec0-32d1-448f-89c4-829c8bb00d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68dab71-594f-4b6f-802c-ec345d0039e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68dab71-594f-4b6f-802c-ec345d0039e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1757621891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93805a-9972-42c8-83c2-5caa1b6c568e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5c1eeab82f4621ad995f2ec1f8d979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:36:25Z,use_quota=True,user_id='e8bb2d5bbeff4469b9a0ce4c6883c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a62a272-a278-418c-ae71-0397bfa75844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a62a272-a278-418c-ae71-0397bfa75844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb912b-b47f-4c14-8b8a-a3b53eadcd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cb912b-b47f-4c14-8b8a-a3b53eadcd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb93805a-9972-42c8-83c2-5caa1b6c568e', 'volume_name': 'volume-eb93805a-9972-42c8-83c2-5caa1b6c568e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f2df7e-f1b8-47c2-8a60-720d28245019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f2df7e-f1b8-47c2-8a60-720d28245019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8bf26e-fc45-4118-b086-1b35ffd411df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:24 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Volume eb93805a-9972-42c8-83c2-5caa1b6c568e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb93805a-9972-42c8-83c2-5caa1b6c568e', 'volume_size': 1}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1757621891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb93805a-9972-42c8-83c2-5caa1b6c568e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a5c1eeab82f4621ad995f2ec1f8d979',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:36:25Z,use_quota=True,user_id='e8bb2d5bbeff4469b9a0ce4c6883c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Creating volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:36:24 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:36:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:24 devstack sudo[103995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e 1073741824
Jul 06 13:36:24 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-a52b3323-b4aa-426e-8129-067f4272229e-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-a52b3323-b4aa-426e-8129-067f4272229e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Deleting offline snapshot a52b3323-b4aa-426e-8129-067f4272229e of volume 96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] snapshot_file for this snap is: volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ff5bd-2d9d-44e1-a4cb-5f6576389911]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:25 devstack sudo[104000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:25 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:25 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e 1073741824" returned: 0 in 0.891s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:25 devstack sudo[104003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e
Jul 06 13:36:25 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:26 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.767s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96c8c6e4-304b-4909-a802-a1d920a05f00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3f196-d7a0-4923-b9ab-07c62b9c6ffd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:26 devstack sudo[104008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:26 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:26 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e" returned: 0 in 0.647s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8bf26e-fc45-4118-b086-1b35ffd411df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb93805a-9972-42c8-83c2-5caa1b6c568e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796c7ba-609e-4f7d-b0f7-3c1ed8f3c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:36:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Volume volume-eb93805a-9972-42c8-83c2-5caa1b6c568e (eb93805a-9972-42c8-83c2-5caa1b6c568e): created successfully
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796c7ba-609e-4f7d-b0f7-3c1ed8f3c67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Flow 'volume_create_manager' (98601ec0-32d1-448f-89c4-829c8bb00d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:36:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d130e4cc-9c95-4886-9a76-50a80f7b65f4 tempest-VolumesSnapshotListTestJSON-1798113805 None] Created volume successfully.
Jul 06 13:36:26 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.783s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:26 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:26 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Creating offline snapshot 2bab4a11-9775-4216-b882-50ff8d593860 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[119123ea-978d-4484-baac-fd215a8b7706]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:27 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e
Jul 06 13:36:27 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:27 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.745s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:27 devstack sudo[104022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e
Jul 06 13:36:27 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:27 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e" returned: 0 in 0.862s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:27 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 1G
Jul 06 13:36:27 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:28 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00.a52b3323-b4aa-426e-8129-067f4272229e" returned: 0 in 0.740s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-a52b3323-b4aa-426e-8129-067f4272229e" released by "_delete_snapshot" :: held 3.145s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" released by "delete_snapshot" :: held 3.173s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Created reservations ['0cc9572e-f1b0-44f7-a94b-df1466ab07ef', '9fbe5d36-3313-4318-84f1-3429cdd4ce5a', 'be629ba6-0d70-4539-8417-120510063aa2', 'bb324430-c3a1-4e07-8c3b-23ba267e44ca'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Delete snapshot completed successfully.
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d4e59001-6c7c-4997-b675-f0006a2d03a7 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-a52b3323-b4aa-426e-8129-067f4272229e-delete_snapshot" released by "delete_snapshot" :: held 3.352s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:28 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 1G" returned: 0 in 0.938s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:28 devstack sudo[104035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:28 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:29 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-96c8c6e4-304b-4909-a802-a1d920a05f00-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.698s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:29 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 is being set with open permissions: ugo+rw
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-96c8c6e4-304b-4909-a802-a1d920a05f00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:29 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:29 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087fc59-df62-4d61-b420-70796d3c2de6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:29 devstack sudo[104042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:29 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:30 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.709s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:30 devstack sudo[104047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info
Jul 06 13:36:30 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:30 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:30 devstack sudo[104051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00
Jul 06 13:36:30 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:30 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info" returned: 0 in 0.681s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:30 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info is being set with open permissions: ugo+rw
Jul 06 13:36:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:30 devstack sudo[104057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info
Jul 06 13:36:30 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:31 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-96c8c6e4-304b-4909-a802-a1d920a05f00" returned: 0 in 0.668s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-96c8c6e4-304b-4909-a802-a1d920a05f00" released by "delete_volume" :: held 1.492s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Created reservations ['645d1959-85f7-41ee-822d-147ed6723410', 'b5272d1c-d733-45b4-bcb4-86e640ad5799', 'c65cf734-e816-4ef7-83e6-eaa8d7056d31', '02f30e67-0ac3-4426-84af-8caea5604d5e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:31 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:36:31 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:31 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.info" returned: 0 in 0.681s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bb336c7a-5091-47c5-b8d9-bac5d8ab69ac tempest-VolumesSnapshotListTestJSON-1798113805 None] Create snapshot completed successfully
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-b03aabc4-a300-473c-a599-d075500d0055-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-b03aabc4-a300-473c-a599-d075500d0055-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" acquired by "delete_volume" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0483e62c-2881-4c0a-87b9-83390c567e7f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:31 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.671s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:36:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Deleted volume successfully.
Jul 06 13:36:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3fb9d634-ef19-465e-a40d-1911468e9abd tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-96c8c6e4-304b-4909-a802-a1d920a05f00-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:31 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055
Jul 06 13:36:31 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Creating offline snapshot 59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ccd76e-8526-481d-976b-61c218e0a4bd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:32 devstack sudo[104065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:32 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:32 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:32 devstack sudo[104070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055
Jul 06 13:36:32 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:33 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.769s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:33 devstack sudo[104076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 1G
Jul 06 13:36:33 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:33 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b03aabc4-a300-473c-a599-d075500d0055" returned: 0 in 0.681s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-quobyte-b03aabc4-a300-473c-a599-d075500d0055" released by "delete_volume" :: held 1.556s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Created reservations ['53bfa645-b872-4e16-9be5-a575fe1defa0', '55930534-a030-4f0b-b3c8-afa6fb1540ef', '2763120e-d134-4524-a10d-c468612492a2', 'd07ff6d5-8294-40ef-b93e-cebc41588bf7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:33 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:36:33 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:34 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 1G" returned: 0 in 0.818s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:34 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:34 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:34 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:36:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Deleted volume successfully.
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6d4c9314-5ce9-416c-8c2f-fd345db78430 tempest-SnapshotDependencyTests-1585397159 None] Lock "cinder-b03aabc4-a300-473c-a599-d075500d0055-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:34 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:34 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 is being set with open permissions: ugo+rw
Jul 06 13:36:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:34 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:34 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:35 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.741s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9622e75a-e3bf-46f4-a1cc-a6b7cc6a1bbe tempest-VolumesSnapshotListTestJSON-1798113805 None] Create snapshot completed successfully
Jul 06 13:36:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Creating offline snapshot 009d7831-e773-42ea-b57c-b808f2f42fc0 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:36:36 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2c56bd-5697-4e39-99a7-8abe3338b440]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:37 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:37 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:37 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.847s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:37 devstack sudo[104100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 1G
Jul 06 13:36:37 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:38 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 1G" returned: 0 in 0.985s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:38 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0
Jul 06 13:36:38 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:39 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0" returned: 0 in 0.715s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:39 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 is being set with open permissions: ugo+rw
Jul 06 13:36:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:39 devstack sudo[104112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0
Jul 06 13:36:39 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:40 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0" returned: 0 in 0.661s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.330s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7ab92d30-c467-463b-8fad-20b2af55cfb1 tempest-VolumesSnapshotListTestJSON-1798113805 None] Create snapshot completed successfully
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-009d7831-e773-42ea-b57c-b808f2f42fc0-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-009d7831-e773-42ea-b57c-b808f2f42fc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-009d7831-e773-42ea-b57c-b808f2f42fc0" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-009d7831-e773-42ea-b57c-b808f2f42fc0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Deleting offline snapshot 009d7831-e773-42ea-b57c-b808f2f42fc0 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] snapshot_file for this snap is: volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d7fb2-a0ea-4836-becb-7f50fdaafe6a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:42 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0
Jul 06 13:36:42 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:42 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0" returned: 0 in 0.806s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[18228c79-a633-4a69-98bf-c754944e1296]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:42 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:42 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:43 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:43 devstack sudo[104134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0
Jul 06 13:36:43 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:44 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0" returned: 0 in 0.787s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:44 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0
Jul 06 13:36:44 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:44 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.009d7831-e773-42ea-b57c-b808f2f42fc0" returned: 0 in 0.602s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-009d7831-e773-42ea-b57c-b808f2f42fc0" released by "_delete_snapshot" :: held 3.108s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" released by "delete_snapshot" :: held 3.131s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Created reservations ['b81dd9b7-083e-46c8-bbe5-9be8c6c4ead1', '5db2dff2-8ac3-44ce-be70-e722faea1769', 'b19bd119-3944-4d19-8f8a-37e291812fba', '2f33cdf5-0472-4d81-990f-6229b480a60e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Delete snapshot completed successfully.
Jul 06 13:36:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8ea32a74-73dc-45c2-a7d4-1f1837fd6512 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-009d7831-e773-42ea-b57c-b808f2f42fc0-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Deleting offline snapshot 59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] snapshot_file for this snap is: volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0f65f-585a-44cf-a12c-6d73836b871a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:46 devstack sudo[104142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:46 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:46 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c7ff2-b347-475b-bb69-46fe93fa1408]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:47 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:47 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:47 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.734s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:47 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:47 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:48 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.713s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:48 devstack sudo[104157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67
Jul 06 13:36:48 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:49 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" returned: 0 in 0.638s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67" released by "_delete_snapshot" :: held 2.924s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" released by "delete_snapshot" :: held 2.945s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=53,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=41,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Created reservations ['83c73250-81c8-46ea-8f6e-4df76b946dfc', '741f9744-81ee-4313-a1db-60b46f89072b', 'df9cbad3-60cd-4d1e-aba0-89f0232f97e8', '8c6cc9da-42e2-4cef-8442-cd1841f12b58'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Delete snapshot completed successfully.
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a1ce377a-1e04-49bc-965c-3a2dfb9a82ff tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-59f69fa4-dd23-4e9b-9c61-84dbe74c2d67-delete_snapshot" released by "delete_snapshot" :: held 3.089s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-2bab4a11-9775-4216-b882-50ff8d593860-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-2bab4a11-9775-4216-b882-50ff8d593860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-2bab4a11-9775-4216-b882-50ff8d593860" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-2bab4a11-9775-4216-b882-50ff8d593860" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Deleting offline snapshot 2bab4a11-9775-4216-b882-50ff8d593860 of volume eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] snapshot_file for this snap is: volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5e4c4b-83e8-43e2-8937-26e61d8acdb8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:49 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:49 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:50 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.738s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb93805a-9972-42c8-83c2-5caa1b6c568e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8406c3-6d0e-4552-bb70-1722439d8cb8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:50 devstack sudo[104165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e
Jul 06 13:36:50 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:50 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e" returned: 0 in 0.732s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:50 devstack sudo[104170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:50 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:51 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.685s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:51 devstack sudo[104175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860
Jul 06 13:36:51 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:52 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e.2bab4a11-9775-4216-b882-50ff8d593860" returned: 0 in 0.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-2bab4a11-9775-4216-b882-50ff8d593860" released by "_delete_snapshot" :: held 2.853s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" released by "delete_snapshot" :: held 2.876s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Created reservations ['a5c86b5c-deab-48ab-bb6f-aef80c82dd88', '4252d185-3f89-4c29-b08c-47e11b3f3fcb', '3cb9076e-bf0a-491d-8e6d-b6c83f73f936', 'd553b6bf-ab88-43e2-bdd0-debc4e1446aa'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Delete snapshot completed successfully.
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-774285fd-00b3-4638-88ae-32e54f9c1d84 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-2bab4a11-9775-4216-b882-50ff8d593860-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-eb93805a-9972-42c8-83c2-5caa1b6c568e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-eb93805a-9972-42c8-83c2-5caa1b6c568e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d878fcb-cf65-44dc-b0e6-b258a313a607]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:36:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:52 devstack sudo[104178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e
Jul 06 13:36:52 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:53 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e" returned: 0 in 0.722s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:53 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e
Jul 06 13:36:53 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:53 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-eb93805a-9972-42c8-83c2-5caa1b6c568e" returned: 0 in 0.640s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-quobyte-eb93805a-9972-42c8-83c2-5caa1b6c568e" released by "delete_volume" :: held 1.418s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Created reservations ['4a0a4b31-a48f-41d5-accc-a8cf2cc0ee00', '0ef8d79d-a353-4693-8c4b-b90f2e53917f', '6498943a-4169-4795-bd17-49318bef1206', 'a23ce6f2-8b49-4898-91dd-abdecda63940'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:36:54 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:36:54 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:36:54 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.660s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:36:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Deleted volume successfully.
Jul 06 13:36:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-33808d8b-72f9-4dff-8d76-e9cc65aae5b8 tempest-VolumesSnapshotListTestJSON-1798113805 None] Lock "cinder-eb93805a-9972-42c8-83c2-5caa1b6c568e-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:36:59 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Flow 'volume_create_manager' (9dc3d5a2-8629-4767-8a96-5f31ebe0a87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508d35c9-c31d-4b69-8e2b-6cd5aa597a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508d35c9-c31d-4b69-8e2b-6cd5aa597a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6f3590-f08d-4553-bbe5-dbed3c9d891e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b37151382f4938af64cbb68cbf2ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:00Z,use_quota=True,user_id='9bfbe89948b9443ca4ea7f77a2b8d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab89fe92-d6fb-4c1e-92fb-5ff526ebb6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab89fe92-d6fb-4c1e-92fb-5ff526ebb6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d180195a-7f51-42bd-a124-659efa7749af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d180195a-7f51-42bd-a124-659efa7749af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd6f3590-f08d-4553-bbe5-dbed3c9d891e', 'volume_name': 'volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e', 'volume_size': 1, 'image_id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3837f23a3d23aa577cb97c8ebd5bf858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33b37151382f4938af64cbb68cbf2ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473b4be0611e90697d3297beef5404d1699114ed527d0d1f117aefe8de26b6805cd826b4d545951b868a18694b02d720d7e2bebdfbeb80b40c258634f9d40efe', 'id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'created_at': datetime.datetime(2026, 7, 6, 11, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359933f3b0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c00559-dcc4-44ef-a7aa-535b3e24716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c00559-dcc4-44ef-a7aa-535b3e24716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263647ac-824e-4f6e-b89f-8fe09c278b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e', 'volume_size': 1, 'image_id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3837f23a3d23aa577cb97c8ebd5bf858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33b37151382f4938af64cbb68cbf2ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473b4be0611e90697d3297beef5404d1699114ed527d0d1f117aefe8de26b6805cd826b4d545951b868a18694b02d720d7e2bebdfbeb80b40c258634f9d40efe', 'id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'created_at': datetime.datetime(2026, 7, 6, 11, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359933f3b0>}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Trying to clone dd6f3590-f08d-4553-bbe5-dbed3c9d891e from image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:37:00 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab972f-cf5e-4c18-864a-6697f8587d8d]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:00 devstack sudo[104190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:00 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:01 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:01 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:01 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:01 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 1 in 0.686s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Temporary image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 is fetched for user 9bfbe89948b9443ca4ea7f77a2b8d09b. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9330e5-8ba1-4011-a962-0d49e9c4a2e5]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:01 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:01 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:02 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:02 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:02 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:03 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 1 in 0.739s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6f3590-f08d-4553-bbe5-dbed3c9d891e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33b37151382f4938af64cbb68cbf2ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:00Z,use_quota=True,user_id='9bfbe89948b9443ca4ea7f77a2b8d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Creating volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:37:03 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:37:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:03 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1073741824
Jul 06 13:37:03 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:04 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1073741824" returned: 0 in 0.850s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:04 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:04 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:04 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 0 in 0.635s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Attempting download of 0a3268b1-a878-4f7b-96eb-a6763c430ed4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}])) to volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac373dd-2f0c-43a1-b76b-8f4e2712de09]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:05 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m
Jul 06 13:37:05 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:05 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m" returned: 0 in 0.690s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:05 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m
Jul 06 13:37:05 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:06 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m" returned: 1 in 0.720s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3268b1-a878-4f7b-96eb-a6763c430ed4_zavxdi6m' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:06 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2f78e5-4a44-451f-bcd5-023335c3b3fc]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:06 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:06 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:07 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 0 in 0.707s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:07 devstack sudo[104230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD
Jul 06 13:37:07 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:07 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD" returned: 1 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] 0a3268b1-a878-4f7b-96eb-a6763c430ed4 was raw, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:37:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:07 devstack sudo[104236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:07 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:08 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 0 in 0.732s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:08 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a3268b1-a878-4f7b-96eb-a6763c430ed4_ftzwxlw3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:37:08 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 13:37:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:08 devstack sudo[104242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1G
Jul 06 13:37:08 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:09 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e 1G" returned: 0 in 0.674s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd1b46-dc78-4406-908e-228c03e76c2e]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:09 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:09 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:10 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 0 in 0.742s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:10 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:10 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:10 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 1 in 0.777s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Downloaded image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}])) to volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Temporary image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 for user 9bfbe89948b9443ca4ea7f77a2b8d09b is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Marking volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Copying metadata from image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 to dd6f3590-f08d-4553-bbe5-dbed3c9d891e. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Creating volume glance metadata for volume dd6f3590-f08d-4553-bbe5-dbed3c9d891e backed by image 0a3268b1-a878-4f7b-96eb-a6763c430ed4 with: {'image_id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3837f23a3d23aa577cb97c8ebd5bf858', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263647ac-824e-4f6e-b89f-8fe09c278b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e', 'volume_size': 1, 'image_id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3837f23a3d23aa577cb97c8ebd5bf858', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33b37151382f4938af64cbb68cbf2ceb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473b4be0611e90697d3297beef5404d1699114ed527d0d1f117aefe8de26b6805cd826b4d545951b868a18694b02d720d7e2bebdfbeb80b40c258634f9d40efe', 'id': '0a3268b1-a878-4f7b-96eb-a6763c430ed4', 'created_at': datetime.datetime(2026, 7, 6, 11, 36, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 36, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3268b1-a878-4f7b-96eb-a6763c430ed4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359933f3b0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189598e0-0763-4172-97e8-3f441337bbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:10 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Volume volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e (dd6f3590-f08d-4553-bbe5-dbed3c9d891e): created successfully
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189598e0-0763-4172-97e8-3f441337bbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:10 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Flow 'volume_create_manager' (9dc3d5a2-8629-4767-8a96-5f31ebe0a87f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-235feb90-f14f-4ac1-a3f2-4fb52ea49503 tempest-VolumeImageDependencyTests-823406227 None] Created volume successfully.
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Acquiring lock "cinder-dd6f3590-f08d-4553-bbe5-dbed3c9d891e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "cinder-dd6f3590-f08d-4553-bbe5-dbed3c9d891e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Acquiring lock "cinder-quobyte-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "cinder-quobyte-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[794f4770-6650-45ef-a00d-cfc915a49fe1]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:11 devstack sudo[104256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:11 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:12 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 0 in 0.828s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:12 devstack sudo[104260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:12 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:13 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 1 in 0.756s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:37:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:13 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e
Jul 06 13:37:13 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:14 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" returned: 0 in 0.649s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "cinder-quobyte-dd6f3590-f08d-4553-bbe5-dbed3c9d891e" released by "delete_volume" :: held 2.292s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Created reservations ['6457f4b4-f748-48ed-9cbd-73385796de64', 'a7831367-7f05-4c5d-9ba6-ef3257f47862', '906f7eee-2459-4a87-b5a6-fa81cef6870e', '15049f2a-5c94-45f5-ae1e-6d1e64869435'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:14 devstack sudo[104305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:37:14 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:14 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.622s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:37:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Deleted volume successfully.
Jul 06 13:37:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43fe8a2b-957c-4c93-bebb-06480c995acb tempest-VolumeImageDependencyTests-823406227 None] Lock "cinder-dd6f3590-f08d-4553-bbe5-dbed3c9d891e-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Flow 'volume_create_manager' (459f7cb7-0c94-4758-8aac-7166fbec6518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a70c2a-b237-4e1b-90e8-a02119fa56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a70c2a-b237-4e1b-90e8-a02119fa56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ba25e3d1748f282146c241c772e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:18Z,use_quota=True,user_id='c46e82bee99e4ff0b75ebed415095874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154c727e-9fb5-4102-a79d-8b7d00e76e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154c727e-9fb5-4102-a79d-8b7d00e76e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d807b95-b0a5-4eb1-8b55-6fb1412dff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d807b95-b0a5-4eb1-8b55-6fb1412dff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b', 'volume_name': 'volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8390cf5-ea1a-4049-b062-8662bc48e2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8390cf5-ea1a-4049-b062-8662bc48e2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b91ec32-be6a-4b53-8075-f096062f2dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Volume 64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b', 'volume_size': 1}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ba25e3d1748f282146c241c772e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:18Z,use_quota=True,user_id='c46e82bee99e4ff0b75ebed415095874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Creating volume 64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:37:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:18 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b 1073741824
Jul 06 13:37:18 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:37:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:37:19 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b 1073741824" returned: 0 in 0.784s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:19 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b
Jul 06 13:37:19 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:19 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" returned: 0 in 0.631s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] <== create_volume: return (1460ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b91ec32-be6a-4b53-8075-f096062f2dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7f123e-bd0c-4a5f-93a1-b0f7fb5fcccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:19 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Volume volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b (64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b): created successfully
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7f123e-bd0c-4a5f-93a1-b0f7fb5fcccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Flow 'volume_create_manager' (459f7cb7-0c94-4758-8aac-7166fbec6518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0be0fac7-7a67-4e95-8013-26a680f9b7b6 tempest-CinderUnicodeTest-924109750 None] Created volume successfully.
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Flow 'volume_create_manager' (e2bbe582-0569-42e1-a2c0-2ee80a1bcab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a98d7-8a79-4b7a-81f4-c4f662bdaab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a98d7-8a79-4b7a-81f4-c4f662bdaab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-747316304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04072e5a-e914-4c69-a99e-b8c414762f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ba25e3d1748f282146c241c772e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:21Z,use_quota=True,user_id='c46e82bee99e4ff0b75ebed415095874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a74981f-eaef-4d29-b3de-692757fa0e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a74981f-eaef-4d29-b3de-692757fa0e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694b3369-8610-4cf0-8295-6a662307dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694b3369-8610-4cf0-8295-6a662307dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04072e5a-e914-4c69-a99e-b8c414762f5c', 'volume_name': 'volume-04072e5a-e914-4c69-a99e-b8c414762f5c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279de962-39e7-4c63-be5f-de080572f7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279de962-39e7-4c63-be5f-de080572f7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52654441-580f-4f9f-892c-27eff9ca3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Volume 04072e5a-e914-4c69-a99e-b8c414762f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04072e5a-e914-4c69-a99e-b8c414762f5c', 'volume_size': 1}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-747316304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04072e5a-e914-4c69-a99e-b8c414762f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b3ba25e3d1748f282146c241c772e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:21Z,use_quota=True,user_id='c46e82bee99e4ff0b75ebed415095874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Creating volume 04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:37:20 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:37:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:20 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c 1073741824
Jul 06 13:37:20 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:21 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c 1073741824" returned: 0 in 0.795s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:21 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c
Jul 06 13:37:21 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:22 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c" returned: 0 in 0.661s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52654441-580f-4f9f-892c-27eff9ca3390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04072e5a-e914-4c69-a99e-b8c414762f5c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c1de82-5874-4826-a580-8f72fbb7a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:22 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Volume volume-04072e5a-e914-4c69-a99e-b8c414762f5c (04072e5a-e914-4c69-a99e-b8c414762f5c): created successfully
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c1de82-5874-4826-a580-8f72fbb7a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Flow 'volume_create_manager' (e2bbe582-0569-42e1-a2c0-2ee80a1bcab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-0ff32b61-f333-4eea-b191-28e30f3e3d6b tempest-CinderUnicodeTest-924109750 None] Created volume successfully.
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Creating offline snapshot 93042e7c-f941-41a5-9325-1a8396621f47 of volume 04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:37:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ea562-7f04-475e-a2ed-a91f49527deb]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:23 devstack sudo[104331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c
Jul 06 13:37:23 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:23 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:23 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 1G
Jul 06 13:37:23 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:24 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 1G" returned: 0 in 0.774s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04072e5a-e914-4c69-a99e-b8c414762f5c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:24 devstack sudo[104343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04072e5a-e914-4c69-a99e-b8c414762f5c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47
Jul 06 13:37:24 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:25 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04072e5a-e914-4c69-a99e-b8c414762f5c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47" returned: 0 in 0.668s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:25 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 is being set with open permissions: ugo+rw
Jul 06 13:37:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:25 devstack sudo[104348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47
Jul 06 13:37:25 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:25 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47" returned: 0 in 0.673s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:25 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info
Jul 06 13:37:25 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:26 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info" returned: 0 in 0.642s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:26 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info is being set with open permissions: ugo+rw
Jul 06 13:37:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:26 devstack sudo[104354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info
Jul 06 13:37:26 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:27 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.info" returned: 0 in 0.643s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7425e0e5-b52c-4a53-a597-1b70cafe5b2f tempest-CinderUnicodeTest-924109750 None] Create snapshot completed successfully
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-93042e7c-f941-41a5-9325-1a8396621f47-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-93042e7c-f941-41a5-9325-1a8396621f47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-quobyte-93042e7c-f941-41a5-9325-1a8396621f47" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-93042e7c-f941-41a5-9325-1a8396621f47" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Deleting offline snapshot 93042e7c-f941-41a5-9325-1a8396621f47 of volume 04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] snapshot_file for this snap is: volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45790fb-fc32-4a03-b49c-fe24cf416277]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:28 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47
Jul 06 13:37:28 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:29 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47" returned: 0 in 0.782s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04072e5a-e914-4c69-a99e-b8c414762f5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97714c0-b94f-496b-a6d2-26e1f50bd81c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:29 devstack sudo[104363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c
Jul 06 13:37:29 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:29 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c" returned: 0 in 0.787s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:29 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47
Jul 06 13:37:29 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:30 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:30 devstack sudo[104373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47
Jul 06 13:37:30 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:31 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c.93042e7c-f941-41a5-9325-1a8396621f47" returned: 0 in 0.622s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-93042e7c-f941-41a5-9325-1a8396621f47" released by "_delete_snapshot" :: held 3.009s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" released by "delete_snapshot" :: held 3.034s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:31 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Created reservations ['a47ce126-e24d-4449-8cc2-eeb8398ae0b9', 'c0abdcf5-79c6-4c3e-90c1-2d8233cc2908', '19aff7d6-3cfc-4bdf-9f34-4506c51419a6', '0cfa5a10-cc70-45f8-9f27-3e689d4f8759'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:37:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Delete snapshot completed successfully.
Jul 06 13:37:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8207a178-b8be-419c-ba19-01e0982a7cfd tempest-CinderUnicodeTest-924109750 None] Lock "cinder-93042e7c-f941-41a5-9325-1a8396621f47-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-04072e5a-e914-4c69-a99e-b8c414762f5c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-04072e5a-e914-4c69-a99e-b8c414762f5c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b97cb8-ff0f-4a72-bc0a-d31b7b5c3a9a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:32 devstack sudo[104378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c
Jul 06 13:37:32 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:33 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:33 devstack sudo[104384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c
Jul 06 13:37:33 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:33 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-04072e5a-e914-4c69-a99e-b8c414762f5c" returned: 0 in 0.629s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-04072e5a-e914-4c69-a99e-b8c414762f5c" released by "delete_volume" :: held 1.408s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:33 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Created reservations ['572e5f90-1d6d-4185-bd08-51f8ec446d24', '740ee168-39c2-40df-8b0a-370db1444594', '68cbde70-2cf9-4e58-b8d1-93d49ac6a376', '75263d21-bf04-44a3-b31b-01592fcd809a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:34 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:37:34 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:34 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.630s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:37:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Deleted volume successfully.
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5781ce52-8e20-4637-b102-90506552b8e6 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-04072e5a-e914-4c69-a99e-b8c414762f5c-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "cinder-quobyte-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" acquired by "delete_volume" :: waited 0.012s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc55f2b7-9f68-4509-928f-c10920a087cf]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:34 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b
Jul 06 13:37:34 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:35 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" returned: 0 in 0.735s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:35 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b
Jul 06 13:37:35 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:36 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" returned: 0 in 0.633s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-quobyte-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b" released by "delete_volume" :: held 1.403s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Created reservations ['fb8bf7d3-2839-45d7-a65e-6c82f610a6d9', '98420336-8ef6-4adf-a530-69c39a65ca6e', 'd6646e5a-e39f-4777-b3ee-7ea0e3c2cf46', '48c6f805-3e37-458f-a03b-f2074e82f295'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:36 devstack sudo[104399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:37:36 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:36 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.674s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:37:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Deleted volume successfully.
Jul 06 13:37:36 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-15f1e598-f1df-4f64-bd38-e2c8d81ea611 tempest-CinderUnicodeTest-924109750 None] Lock "cinder-64d29ddd-2f4a-4bc5-878a-7a04f5e9a11b-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:37:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=60,cinder:SELECT=47,cinder:INSERT=19,cinder:DELETE=1 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:37:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=53,cinder:INSERT=22,cinder:UPDATE=62,cinder:DELETE=7 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Flow 'volume_create_manager' (082096a9-d384-4323-9956-c487a9c5ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da068c-b152-47cf-9534-92aa08519bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84da068c-b152-47cf-9534-92aa08519bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369058569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89b342-a3e5-44eb-809c-d10ed1fc4932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e09b582a5844c1495fe7014a8e50453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:53Z,use_quota=True,user_id='a185752defb2473d8bcb49f020635186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a5e6eb-8d03-41c4-afbe-11eba32cd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a5e6eb-8d03-41c4-afbe-11eba32cd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6debda1a-cc2c-40e4-a135-a7538e62c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6debda1a-cc2c-40e4-a135-a7538e62c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc89b342-a3e5-44eb-809c-d10ed1fc4932', 'volume_name': 'volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3482b146-ad28-4814-8f14-9851057ae4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3482b146-ad28-4814-8f14-9851057ae4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e0c281-a073-4228-a2ee-5afc77332054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Volume cc89b342-a3e5-44eb-809c-d10ed1fc4932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932', 'volume_size': 1}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-369058569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc89b342-a3e5-44eb-809c-d10ed1fc4932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e09b582a5844c1495fe7014a8e50453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:53Z,use_quota=True,user_id='a185752defb2473d8bcb49f020635186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Creating volume cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:37:53 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:53 devstack sudo[104440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 1073741824
Jul 06 13:37:53 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (7b6d42c6-7c8e-407c-8164-f3b67343ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50113701-a860-4086-bfc6-340ae95a5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50113701-a860-4086-bfc6-340ae95a5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892424737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95376e90-e7fd-41e9-a8d2-3efda650d4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:53Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10832c0a-ec8b-43cd-9994-b35e30e8257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10832c0a-ec8b-43cd-9994-b35e30e8257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffad99a-ac5d-42ba-b928-c594bbd42dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ffad99a-ac5d-42ba-b928-c594bbd42dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95376e90-e7fd-41e9-a8d2-3efda650d4c9', 'volume_name': 'volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b5505d-9894-42be-b6a3-fff6b35a0a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b5505d-9894-42be-b6a3-fff6b35a0a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c044599-c16b-495b-b568-68dbe3bef39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume 95376e90-e7fd-41e9-a8d2-3efda650d4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9', 'volume_size': 1}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8aef9be7-6c55-4336-a4bf-49f3b3843b9d tempest-ProjectAdminTests-888593689 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7531204223633, 'free_capacity_gb': 1775.7531204223633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86698) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 13:37:54 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 1073741824" returned: 0 in 1.039s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:54 devstack sudo[104446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:37:54 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:55 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 0.724s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892424737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95376e90-e7fd-41e9-a8d2-3efda650d4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:53Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume 95376e90-e7fd-41e9-a8d2-3efda650d4c9 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:37:55 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:55 devstack sudo[104449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 1073741824
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e0c281-a073-4228-a2ee-5afc77332054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:55 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2ca362-6e45-45c2-8097-9a33ad4f9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:55 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Volume volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 (cc89b342-a3e5-44eb-809c-d10ed1fc4932): created successfully
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2ca362-6e45-45c2-8097-9a33ad4f9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:55 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Flow 'volume_create_manager' (082096a9-d384-4323-9956-c487a9c5ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c6d7afc2-b5cf-41cf-b352-fc1cd68a79d3 tempest-VolumeDependencyTests-1992328528 None] Created volume successfully.
Jul 06 13:37:56 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 1073741824" returned: 0 in 1.047s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:56 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9
Jul 06 13:37:56 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:56 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9" returned: 0 in 0.721s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.590s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Creating offline snapshot f0004236-94d7-43c2-86db-25388d03e283 of volume cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c044599-c16b-495b-b568-68dbe3bef39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c09baa5-9689-4e49-92ad-ad46bfdf958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[79697b3a-9fc7-4d54-813f-47cb592b9b25]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:56 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 (95376e90-e7fd-41e9-a8d2-3efda650d4c9): created successfully
Jul 06 13:37:56 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c09baa5-9689-4e49-92ad-ad46bfdf958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (7b6d42c6-7c8e-407c-8164-f3b67343ae49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2209ed02-3629-4efe-b7a9-d0b9d55a3b5e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:37:57 devstack sudo[104458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:57 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Flow 'volume_create_manager' (fc9e6cfb-3725-4a5a-86b6-0b8ce3d774c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5775c39-720d-46bc-998e-a173006e2027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5775c39-720d-46bc-998e-a173006e2027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40596952-fd87-4354-81ca-3d607214c96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df44cffc38934eacbf16fa836ac76cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:57Z,use_quota=True,user_id='6b488244680b437da7182dba58328ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9605f948-2f8f-459a-b965-6858dd96b58b),volume_type_id=9605f948-2f8f-459a-b965-6858dd96b58b)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9711e2f-8fc9-4426-abf0-1897379c1894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9711e2f-8fc9-4426-abf0-1897379c1894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00640d2b-51e6-4ec5-90e3-2ffef7379e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00640d2b-51e6-4ec5-90e3-2ffef7379e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40596952-fd87-4354-81ca-3d607214c96c', 'volume_name': 'volume-40596952-fd87-4354-81ca-3d607214c96c', 'volume_size': 1, 'image_id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d2780ef3e275f95928dd327088ca42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df44cffc38934eacbf16fa836ac76cb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2615c777f12f10201da4aa520b604df89eb876d5e9da79f10065997255dc13b8ab02e9927ce7998853afcc8f29055ad425f98dad12beec66f02761a1262851b', 'id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'created_at': datetime.datetime(2026, 7, 6, 11, 37, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 37, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d29ba29-7270-4ebf-bee2-efac5907867b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599268530>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3938dd93-b5b7-47f4-85a4-04906d24763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3938dd93-b5b7-47f4-85a4-04906d24763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab16c2-8f89-4c7c-a802-c5fa23e8e880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:57 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Volume 40596952-fd87-4354-81ca-3d607214c96c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40596952-fd87-4354-81ca-3d607214c96c', 'volume_size': 1, 'image_id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d2780ef3e275f95928dd327088ca42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df44cffc38934eacbf16fa836ac76cb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2615c777f12f10201da4aa520b604df89eb876d5e9da79f10065997255dc13b8ab02e9927ce7998853afcc8f29055ad425f98dad12beec66f02761a1262851b', 'id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'created_at': datetime.datetime(2026, 7, 6, 11, 37, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 37, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d29ba29-7270-4ebf-bee2-efac5907867b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599268530>}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Trying to clone 40596952-fd87-4354-81ca-3d607214c96c from image 0d29ba29-7270-4ebf-bee2-efac5907867b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:37:57 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 13:37:57 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 0.996s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:57 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:57 devstack sudo[104463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 1G
Jul 06 13:37:57 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (c1041012-0430-44fc-b4df-1f6873d68704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163e2c67-f524-4c3e-8002-b786af3f02d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac312e6e-0569-440e-9b58-e4a5e2c59849]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163e2c67-f524-4c3e-8002-b786af3f02d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291254396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5bee27-b7cc-4776-9e01-f76765d1b3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:58Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897e663-c31a-47f3-bec6-bd38383a1819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3897e663-c31a-47f3-bec6-bd38383a1819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e681973-f6dd-4948-9d73-15012ca87dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e681973-f6dd-4948-9d73-15012ca87dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5bee27-b7cc-4776-9e01-f76765d1b3bf', 'volume_name': 'volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb9585-63f7-487c-ade7-079c0bd89925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cb9585-63f7-487c-ade7-079c0bd89925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d5d73e-c968-4329-b838-e8fff137016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume ae5bee27-b7cc-4776-9e01-f76765d1b3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf', 'volume_size': 1}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:58 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:37:58 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (0567319b-675c-47ee-af2c-670d0c7e1927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73f225-958c-4b70-85f9-76254cb15aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73f225-958c-4b70-85f9-76254cb15aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-346131548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726f7c63-5bde-4e1c-af98-34be1e6c1dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:58Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ac2970-8b1e-4085-9577-5d01c768ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ac2970-8b1e-4085-9577-5d01c768ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed687c9e-7908-408f-8ec6-984165cfd7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed687c9e-7908-408f-8ec6-984165cfd7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726f7c63-5bde-4e1c-af98-34be1e6c1dd9', 'volume_name': 'volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fb8c87-8a63-42d9-8f15-104d5ac0feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fb8c87-8a63-42d9-8f15-104d5ac0feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bcac46-2d7f-4eb6-847c-a54e7ee52258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume 726f7c63-5bde-4e1c-af98-34be1e6c1dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9', 'volume_size': 1}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (1978a149-a44e-41fb-9164-d1d0e700e59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e5927-3fec-4eaa-92c1-22dbb647333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e5927-3fec-4eaa-92c1-22dbb647333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417707599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666f470f-7655-4fd2-9646-5391344e382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:59Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4c6aac-9cd0-42d3-a4da-97345e37d1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4c6aac-9cd0-42d3-a4da-97345e37d1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a81e0e-15b8-435d-81d1-2d07bfd8dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a81e0e-15b8-435d-81d1-2d07bfd8dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666f470f-7655-4fd2-9646-5391344e382a', 'volume_name': 'volume-666f470f-7655-4fd2-9646-5391344e382a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef3575b-1126-4175-8d33-cdc1f65c50b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef3575b-1126-4175-8d33-cdc1f65c50b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61110e01-bb79-48d7-b1f9-5b63b8f32da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume 666f470f-7655-4fd2-9646-5391344e382a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666f470f-7655-4fd2-9646-5391344e382a', 'volume_size': 1}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:59 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 1G" returned: 0 in 1.118s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:37:59 devstack sudo[104475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:37:59 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:59 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:37:59 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (66123d01-d245-418e-bbb4-0b98ec76801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9517e24-2627-47af-9c2e-649d3636001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9517e24-2627-47af-9c2e-649d3636001f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325fdf69-d2eb-42c9-b5a8-e2d7d47b461a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:00Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc33102d-758b-4c80-8eb6-cebafc8610c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc33102d-758b-4c80-8eb6-cebafc8610c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ffdf6b-012f-4759-a9d3-8f9cc93d0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13ffdf6b-012f-4759-a9d3-8f9cc93d0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '325fdf69-d2eb-42c9-b5a8-e2d7d47b461a', 'volume_name': 'volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b310aa-13e8-457e-902c-c2b246f0e189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b310aa-13e8-457e-902c-c2b246f0e189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf57947d-5675-404f-a4fb-7ff46bba59c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:37:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume 325fdf69-d2eb-42c9-b5a8-e2d7d47b461a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a', 'volume_size': 1}
Jul 06 13:37:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:00 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:00 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 is being set with open permissions: ugo+rw
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:00 devstack sudo[104484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:38:00 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:00 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 1 in 1.120s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Temporary image 0d29ba29-7270-4ebf-bee2-efac5907867b is fetched for user 6b488244680b437da7182dba58328ad7. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (5f7cacae-0e6c-496d-94b5-15ef4b6ba2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824094ff-944c-4990-b9f5-a835ce055f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824094ff-944c-4990-b9f5-a835ce055f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018247958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78490b2a-cb49-40c6-8c8a-927e5a1d409f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:00Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e199921-e867-434a-ad1e-e57a2edf6f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e199921-e867-434a-ad1e-e57a2edf6f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fceec15-303a-4c42-b335-61269d9e876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fceec15-303a-4c42-b335-61269d9e876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78490b2a-cb49-40c6-8c8a-927e5a1d409f', 'volume_name': 'volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1d1261-21ba-467c-a357-4302be7e4d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1d1261-21ba-467c-a357-4302be7e4d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20905d54-196c-4fad-a088-8047290b6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume 78490b2a-cb49-40c6-8c8a-927e5a1d409f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f', 'volume_size': 1}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6afe57e-3376-4fbf-8335-305856c660d6]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:00 devstack sudo[104486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:38:00 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:00 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:00 devstack sudo[104489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info
Jul 06 13:38:00 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:01 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 0 in 0.819s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:01 devstack sudo[104493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:38:01 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:01 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:01 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info is being set with open permissions: ugo+rw
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:01 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info
Jul 06 13:38:01 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:01 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 1 in 0.832s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:02 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.info" returned: 0 in 0.702s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.410s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.193s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-291254396',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae5bee27-b7cc-4776-9e01-f76765d1b3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:58Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume ae5bee27-b7cc-4776-9e01-f76765d1b3bf {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:02 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:02 devstack sudo[104502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf 1073741824
Jul 06 13:38:02 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d60a011b-c5cc-41ad-b252-96d26a814a57 tempest-VolumeDependencyTests-1992328528 None] Create snapshot completed successfully
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Flow 'volume_create_manager' (3ca8ebd6-d445-4d2f-8bfd-a69f89b979ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905132d-d6be-46b7-a27c-59ec78a3852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:03 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf 1073741824" returned: 0 in 0.957s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905132d-d6be-46b7-a27c-59ec78a3852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2055382906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdda4921-9ed3-41a9-a0dd-caf153060349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e09b582a5844c1495fe7014a8e50453',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0004236-94d7-43c2-86db-25388d03e283,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:03Z,use_quota=True,user_id='a185752defb2473d8bcb49f020635186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be90ce37-05b0-4534-b1f7-1223c164d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be90ce37-05b0-4534-b1f7-1223c164d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f19b57f-1348-455d-bbec-c9640dc33e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f19b57f-1348-455d-bbec-c9640dc33e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bdda4921-9ed3-41a9-a0dd-caf153060349', 'volume_name': 'volume-bdda4921-9ed3-41a9-a0dd-caf153060349', 'volume_size': 1, 'snapshot_id': 'f0004236-94d7-43c2-86db-25388d03e283'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d11a33-fa5d-476a-9415-8d30bf75391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d11a33-fa5d-476a-9415-8d30bf75391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641ad1fe-0071-4a07-88f6-d5671a615beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:03 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Volume bdda4921-9ed3-41a9-a0dd-caf153060349: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bdda4921-9ed3-41a9-a0dd-caf153060349', 'volume_size': 1, 'snapshot_id': 'f0004236-94d7-43c2-86db-25388d03e283'}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:03 devstack sudo[104509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf
Jul 06 13:38:03 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:04 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" returned: 0 in 0.743s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.430s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-346131548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726f7c63-5bde-4e1c-af98-34be1e6c1dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:58Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume 726f7c63-5bde-4e1c-af98-34be1e6c1dd9 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:04 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:04 devstack sudo[104512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 1073741824
Jul 06 13:38:04 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d5d73e-c968-4329-b838-e8fff137016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec63f9f-50c7-47ba-92bc-51163fff3b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:04 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf (ae5bee27-b7cc-4776-9e01-f76765d1b3bf): created successfully
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec63f9f-50c7-47ba-92bc-51163fff3b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:04 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (c1041012-0430-44fc-b4df-1f6873d68704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ae5e512e-1c7e-4a4e-a40f-ad5811137f92 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:38:05 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 1073741824" returned: 0 in 0.909s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:05 devstack sudo[104518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9
Jul 06 13:38:05 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:05 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" returned: 0 in 0.712s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.747s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417707599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666f470f-7655-4fd2-9646-5391344e382a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:59Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume 666f470f-7655-4fd2-9646-5391344e382a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:05 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:05 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a 1073741824
Jul 06 13:38:05 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bcac46-2d7f-4eb6-847c-a54e7ee52258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0b6660-99c1-4dd9-9953-3ca27c2fbfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:05 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 (726f7c63-5bde-4e1c-af98-34be1e6c1dd9): created successfully
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0b6660-99c1-4dd9-9953-3ca27c2fbfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:05 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (0567319b-675c-47ee-af2c-670d0c7e1927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:05 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fefb3d0a-1963-4dcd-b9e7-798f60e1ee1f tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:38:06 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a 1073741824" returned: 0 in 1.023s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:06 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a
Jul 06 13:38:06 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:07 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a" returned: 0 in 0.695s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.869s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=325fdf69-d2eb-42c9-b5a8-e2d7d47b461a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:00Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume 325fdf69-d2eb-42c9-b5a8-e2d7d47b461a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:07 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:07 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a 1073741824
Jul 06 13:38:07 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61110e01-bb79-48d7-b1f9-5b63b8f32da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666f470f-7655-4fd2-9646-5391344e382a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f03493-36fa-49dd-9bf6-6bea286d1cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-666f470f-7655-4fd2-9646-5391344e382a (666f470f-7655-4fd2-9646-5391344e382a): created successfully
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f03493-36fa-49dd-9bf6-6bea286d1cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (1978a149-a44e-41fb-9164-d1d0e700e59e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-69672a74-4441-4b0c-8fa5-aaec647c1a1a tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:38:08 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a 1073741824" returned: 0 in 0.936s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:08 devstack sudo[104538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a
Jul 06 13:38:08 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:09 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" returned: 0 in 0.689s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.966s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1018247958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78490b2a-cb49-40c6-8c8a-927e5a1d409f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2c0544fd8304935a862a6d16c2b2c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:00Z,use_quota=True,user_id='98b02106a3b746d2a22c0ac50e39161e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Creating volume 78490b2a-cb49-40c6-8c8a-927e5a1d409f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:09 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:09 devstack sudo[104541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f 1073741824
Jul 06 13:38:09 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf57947d-5675-404f-a4fb-7ff46bba59c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4b3a4b-8ce5-4d4a-922e-d728992a7bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a (325fdf69-d2eb-42c9-b5a8-e2d7d47b461a): created successfully
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a4b3a4b-8ce5-4d4a-922e-d728992a7bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (66123d01-d245-418e-bbb4-0b98ec76801b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8423b15e-ac21-43df-910b-0a9fba2f98f2 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:38:10 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f 1073741824" returned: 0 in 1.029s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:10 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f
Jul 06 13:38:10 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:10 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f" returned: 0 in 0.664s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.036s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40596952-fd87-4354-81ca-3d607214c96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df44cffc38934eacbf16fa836ac76cb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:37:57Z,use_quota=True,user_id='6b488244680b437da7182dba58328ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9605f948-2f8f-459a-b965-6858dd96b58b),volume_type_id=9605f948-2f8f-459a-b965-6858dd96b58b)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Creating volume 40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:11 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20905d54-196c-4fad-a088-8047290b6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:11 devstack sudo[104550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1073741824
Jul 06 13:38:11 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710b81d5-89e2-444c-a3bd-e9d48a78e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Volume volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f (78490b2a-cb49-40c6-8c8a-927e5a1d409f): created successfully
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710b81d5-89e2-444c-a3bd-e9d48a78e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Flow 'volume_create_manager' (5f7cacae-0e6c-496d-94b5-15ef4b6ba2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-05837b6c-345e-47c1-974e-1b7001d2f5b8 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created volume successfully.
Jul 06 13:38:12 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1073741824" returned: 0 in 0.989s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:12 devstack sudo[104556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:12 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-78490b2a-cb49-40c6-8c8a-927e5a1d409f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-78490b2a-cb49-40c6-8c8a-927e5a1d409f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-78490b2a-cb49-40c6-8c8a-927e5a1d409f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-78490b2a-cb49-40c6-8c8a-927e5a1d409f" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b2cc68-d76c-4397-8e66-8463a78ad43b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:12 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f
Jul 06 13:38:12 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:12 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 0 in 0.736s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.447s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283-bdda4921-9ed3-41a9-a0dd-caf153060349" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283-bdda4921-9ed3-41a9-a0dd-caf153060349" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Creating volume bdda4921-9ed3-41a9-a0dd-caf153060349 from snapshot f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Attempting download of 0d29ba29-7270-4ebf-bee2-efac5907867b ((None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}])) to volume 40596952-fd87-4354-81ca-3d607214c96c. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] snapshot: f0004236-94d7-43c2-86db-25388d03e283, volume: bdda4921-9ed3-41a9-a0dd-caf153060349,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee042a3f-b3f4-4116-823d-166e0317021e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:13 devstack sudo[104561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:38:13 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b997fe-69f1-49d3-8f17-6cdf5563c1d6]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:13 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f" returned: 0 in 0.897s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:13 devstack sudo[104568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f
Jul 06 13:38:13 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:13 devstack sudo[104567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb
Jul 06 13:38:13 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:13 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 1.036s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aacd173-decc-4611-a8e8-b93569fc9510]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:14 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-78490b2a-cb49-40c6-8c8a-927e5a1d409f" returned: 0 in 0.796s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-78490b2a-cb49-40c6-8c8a-927e5a1d409f" released by "delete_volume" :: held 1.757s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:14 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb" returned: 0 in 0.955s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['d62e15b7-ca23-4ebf-9975-4cbf87deca56', '5bdf22b4-d9e4-48b4-bc2a-4192f7c951f1', '9b9d7608-e734-45c5-b924-2ad4a8198fc5', 'f609fe59-cb76-48b7-99ea-0cf095756594'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:14 devstack sudo[104609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:38:14 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:14 devstack sudo[104612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb
Jul 06 13:38:14 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:14 devstack sudo[104617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:14 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc46265-067a-4578-bd55-c79521dee21c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:14 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a
Jul 06 13:38:14 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:15 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.978s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-17ee5c51-4d58-4bcf-b18c-5d7b10773491 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-78490b2a-cb49-40c6-8c8a-927e5a1d409f-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:15 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 1.659s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:15 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349
Jul 06 13:38:15 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:15 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb" returned: 1 in 1.785s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d29ba29-7270-4ebf-bee2-efac5907867b_ozsdlnqb' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7c636-d78a-4426-b46d-cd4295d56347]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:16 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" returned: 0 in 1.299s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:16 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:38:16 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:16 devstack sudo[104634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a
Jul 06 13:38:16 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:17 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" returned: 0 in 1.208s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a" released by "delete_volume" :: held 2.625s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['c3272265-8776-48b6-8f9f-9e7368b36649', 'c5bf3676-2630-441c-93a3-ea89b418f0b4', 'f5367a41-1a4d-49cc-b84b-6066058b4f6b', '1932bc29-be56-4752-a616-d704bb594afc'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:17 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 0 in 1.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:17 devstack sudo[104652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:17 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:18 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD
Jul 06 13:38:18 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-666f470f-7655-4fd2-9646-5391344e382a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-666f470f-7655-4fd2-9646-5391344e382a-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:18 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:18 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-666f470f-7655-4fd2-9646-5391344e382a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-666f470f-7655-4fd2-9646-5391344e382a" acquired by "delete_volume" :: waited 0.063s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec32c34-b76a-4990-a7f1-3f9a588fb5ef]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:19 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a
Jul 06 13:38:19 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:20 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD" returned: 1 in 2.547s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] 0d29ba29-7270-4ebf-bee2-efac5907867b was raw, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:20 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:20 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:20 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.720s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3971aef9-3ac1-4216-aedc-4871908a5ce5 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-325fdf69-d2eb-42c9-b5a8-e2d7d47b461a-delete_volume" released by "delete_volume" :: held 6.114s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:20 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 2.266s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:38:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:38:21 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a" returned: 0 in 2.797s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:21 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a
Jul 06 13:38:21 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:22 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 0 in 2.565s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:22 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d29ba29-7270-4ebf-bee2-efac5907867b_83m9j5lhdevstack@QuobyteHD, size 0.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:38:22 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 13:38:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:22 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1G
Jul 06 13:38:22 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:23 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349" returned: 0 in 7.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a0052-4ca7-4412-a9ab-417a793fa987]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:23 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:38:23 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:23 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-666f470f-7655-4fd2-9646-5391344e382a" returned: 0 in 2.011s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-666f470f-7655-4fd2-9646-5391344e382a" released by "delete_volume" :: held 4.979s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:23 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c 1G" returned: 0 in 1.116s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['ea372102-2f3e-417c-8345-7c9383be7b46', '139bf4a6-0ae4-4639-8a53-d1d3c3557773', 'eadf6894-e257-40f5-b79d-40f4743c38da', '115c6876-263f-477f-bd85-e953a1c45a40'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce161e-6019-4994-b431-931fd455f771]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:24 devstack sudo[104691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:24 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:24 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:24 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-726f7c63-5bde-4e1c-af98-34be1e6c1dd9-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-726f7c63-5bde-4e1c-af98-34be1e6c1dd9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc764306-458b-440a-ac28-01d104290e7a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:24 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.809s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:24 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9
Jul 06 13:38:24 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c4d87d9d-5d1c-4179-b9d3-624130dc309c tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-666f470f-7655-4fd2-9646-5391344e382a-delete_volume" released by "delete_volume" :: held 6.387s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:24 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 1.467s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932, size 1024.00 MB, duration 7.79 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:38:24 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Converted 1024.00 MB image at 131.39 MB/s
Jul 06 13:38:24 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 is being set with open permissions: ugo+rw
Jul 06 13:38:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:24 devstack sudo[104702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349
Jul 06 13:38:24 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:25 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 0 in 1.102s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:25 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:25 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:25 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" returned: 0 in 0.963s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:25 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9
Jul 06 13:38:25 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:25 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349" returned: 0 in 0.970s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" released by "_copy_volume_from_snapshot" :: held 13.059s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283-bdda4921-9ed3-41a9-a0dd-caf153060349" released by "_create_volume_from_snapshot" :: held 13.105s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.138s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (641ad1fe-0071-4a07-88f6-d5671a615beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdda4921-9ed3-41a9-a0dd-caf153060349', 'volume_size': 1, 'snapshot_id': 'f0004236-94d7-43c2-86db-25388d03e283'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23bb16d-281d-4add-805f-93ffbddeaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Volume volume-bdda4921-9ed3-41a9-a0dd-caf153060349 (bdda4921-9ed3-41a9-a0dd-caf153060349): created successfully
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23bb16d-281d-4add-805f-93ffbddeaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Flow 'volume_create_manager' (3ca8ebd6-d445-4d2f-8bfd-a69f89b979ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-eb4ad3b1-6efd-4eb7-ab27-4ebb53b50474 tempest-VolumeDependencyTests-1992328528 None] Created volume successfully.
Jul 06 13:38:26 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 1 in 1.095s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Downloaded image 0d29ba29-7270-4ebf-bee2-efac5907867b ((None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}])) to volume 40596952-fd87-4354-81ca-3d607214c96c successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Temporary image 0d29ba29-7270-4ebf-bee2-efac5907867b for user 6b488244680b437da7182dba58328ad7 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Marking volume 40596952-fd87-4354-81ca-3d607214c96c as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Copying metadata from image 0d29ba29-7270-4ebf-bee2-efac5907867b to 40596952-fd87-4354-81ca-3d607214c96c. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Creating volume glance metadata for volume 40596952-fd87-4354-81ca-3d607214c96c backed by image 0d29ba29-7270-4ebf-bee2-efac5907867b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '05d2780ef3e275f95928dd327088ca42', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ab16c2-8f89-4c7c-a802-c5fa23e8e880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40596952-fd87-4354-81ca-3d607214c96c', 'volume_size': 1, 'image_id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d29ba29-7270-4ebf-bee2-efac5907867b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05d2780ef3e275f95928dd327088ca42', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'df44cffc38934eacbf16fa836ac76cb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2615c777f12f10201da4aa520b604df89eb876d5e9da79f10065997255dc13b8ab02e9927ce7998853afcc8f29055ad425f98dad12beec66f02761a1262851b', 'id': '0d29ba29-7270-4ebf-bee2-efac5907867b', 'created_at': datetime.datetime(2026, 7, 6, 11, 37, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 37, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d29ba29-7270-4ebf-bee2-efac5907867b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x723599268530>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbebf78-d1be-4080-a8cf-2544598fa4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Volume volume-40596952-fd87-4354-81ca-3d607214c96c (40596952-fd87-4354-81ca-3d607214c96c): created successfully
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbebf78-d1be-4080-a8cf-2544598fa4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Flow 'volume_create_manager' (fc9e6cfb-3725-4a5a-86b6-0b8ce3d774c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8f2e601e-3ca6-4adc-a1cd-7b60f9e8b4f7 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Created volume successfully.
Jul 06 13:38:26 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" returned: 0 in 0.766s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-726f7c63-5bde-4e1c-af98-34be1e6c1dd9" released by "delete_volume" :: held 1.780s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['f10dba6b-5c77-463e-a264-930e2497a792', '28fa6bb6-798e-4585-86b6-5ebdf2cc0a6f', '523cc2cd-8f50-4183-b2d9-c3afed8c7588', '1720649f-bd58-4001-8dc8-d8c194fd9fb8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:26 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:26 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-f0004236-94d7-43c2-86db-25388d03e283-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-f0004236-94d7-43c2-86db-25388d03e283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Deleting offline snapshot f0004236-94d7-43c2-86db-25388d03e283 of volume cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] snapshot_file for this snap is: volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd8b46-c68e-44fb-bd76-fb612f9ab15a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-ae5bee27-b7cc-4776-9e01-f76765d1b3bf-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-ae5bee27-b7cc-4776-9e01-f76765d1b3bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48ca57-1201-4339-bdd1-f19987856305]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:27 devstack sudo[104718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:38:27 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:27 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf
Jul 06 13:38:27 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Acquiring lock "cinder-40596952-fd87-4354-81ca-3d607214c96c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "cinder-40596952-fd87-4354-81ca-3d607214c96c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Acquiring lock "cinder-quobyte-40596952-fd87-4354-81ca-3d607214c96c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "cinder-quobyte-40596952-fd87-4354-81ca-3d607214c96c" acquired by "delete_volume" :: waited 0.033s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:27 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.874s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e278a464-24b4-4a03-939c-7d6d5532e329 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-726f7c63-5bde-4e1c-af98-34be1e6c1dd9-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7102ba0-0561-4982-a7e4-b149b85eb306]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:27 devstack sudo[104723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:27 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:28 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 1.100s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0595ba92-6536-471a-855e-827b179b3e9f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:28 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:38:28 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:28 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" returned: 0 in 1.140s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:28 devstack sudo[104734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf
Jul 06 13:38:28 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:28 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 0 in 1.097s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:28 devstack sudo[104738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:28 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:29 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 0.978s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:29 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" returned: 0 in 0.828s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:29 devstack sudo[104745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:38:29 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-ae5bee27-b7cc-4776-9e01-f76765d1b3bf" released by "delete_volume" :: held 2.022s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['1b083961-041f-4cfa-b412-5a2334332e41', '77c2ee25-ff19-4f87-8ed2-2fd534de60f6', 'c7a6bca3-7438-4869-85bd-62d19ca56a7b', 'd66c941a-7a08-4c4e-9487-a24aa7e1e2ec'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:29 devstack sudo[104747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:29 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:29 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 1 in 1.032s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:29 devstack sudo[104752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c
Jul 06 13:38:29 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:30 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 1.066s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:30 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283
Jul 06 13:38:30 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:30 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.939s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-701ed89c-0b71-4f05-9549-6a3fa123963e tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-ae5bee27-b7cc-4776-9e01-f76765d1b3bf-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-95376e90-e7fd-41e9-a8d2-3efda650d4c9-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-95376e90-e7fd-41e9-a8d2-3efda650d4c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:30 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-40596952-fd87-4354-81ca-3d607214c96c" returned: 0 in 0.783s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "cinder-quobyte-40596952-fd87-4354-81ca-3d607214c96c" released by "delete_volume" :: held 3.028s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "cinder-quobyte-95376e90-e7fd-41e9-a8d2-3efda650d4c9" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-95376e90-e7fd-41e9-a8d2-3efda650d4c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[508da8ab-8432-4e28-b388-9a61be0d8303]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Created reservations ['8c587079-eeb7-4bdd-a110-4f63132e85c4', '8bca3983-3cfb-4357-bea9-6182b43c4cc7', '77016b58-a027-4506-ac8b-9e2370bfefa8', '092110ac-8994-4f42-a58d-0a44e141b1cc'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:30 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:30 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:30 devstack sudo[104761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9
Jul 06 13:38:30 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:31 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932.f0004236-94d7-43c2-86db-25388d03e283" returned: 0 in 0.916s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-f0004236-94d7-43c2-86db-25388d03e283" released by "_delete_snapshot" :: held 4.205s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" released by "delete_snapshot" :: held 4.257s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Created reservations ['5f0c204a-471d-4a11-93e9-1d85cbd39c58', '5a503f48-6ae3-4d79-a372-898b29991dfa', '4b332b00-4a1f-4a81-805f-cbe74246bbf1', 'd2ee059e-3c1a-4ded-a26b-01b55e4d3541'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Delete snapshot completed successfully.
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-e424431b-6142-44fd-bb06-208b0f06715d tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-f0004236-94d7-43c2-86db-25388d03e283-delete_snapshot" released by "delete_snapshot" :: held 4.536s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:31 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9" returned: 0 in 1.250s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:31 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9
Jul 06 13:38:31 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:31 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.183s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Deleted volume successfully.
Jul 06 13:38:31 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-96b24f79-18be-4127-ac23-1f2aa5291239 tempest-VolumeAndVolumeTypeFromImageTest-1951872311 None] Lock "cinder-40596952-fd87-4354-81ca-3d607214c96c-delete_volume" released by "delete_volume" :: held 4.583s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-cc89b342-a3e5-44eb-809c-d10ed1fc4932-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-cc89b342-a3e5-44eb-809c-d10ed1fc4932-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac67718-4094-4d99-93a4-5ca24a261415]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:32 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:38:32 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:32 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-95376e90-e7fd-41e9-a8d2-3efda650d4c9" returned: 0 in 0.823s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-quobyte-95376e90-e7fd-41e9-a8d2-3efda650d4c9" released by "delete_volume" :: held 2.144s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Created reservations ['eecab0d8-de4a-40f5-bdd5-963342c46513', '6adcd644-0777-4518-85b5-1394394ea41b', '0fdc92e0-c906-46a9-9a2d-b7014185b044', 'ff37dc18-2832-447e-8a69-ce932aaa48d2'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:32 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:32 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:33 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 1.196s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:33 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932
Jul 06 13:38:33 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:33 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.802s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:33 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:33 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Deleted volume successfully.
Jul 06 13:38:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c8becee-1825-4704-a1dd-e08b713e7354 tempest-CreateVolumesFromSourceVolumeTest-1843873580 None] Lock "cinder-95376e90-e7fd-41e9-a8d2-3efda650d4c9-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:34 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-cc89b342-a3e5-44eb-809c-d10ed1fc4932" returned: 0 in 1.040s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-cc89b342-a3e5-44eb-809c-d10ed1fc4932" released by "delete_volume" :: held 2.325s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Created reservations ['34e4d569-00dc-4749-9f1f-f3096adb79dd', 'bbb8adbb-f770-420b-ab1d-e83fcc2e00a9', '5ef7cef6-b9ee-4973-822c-ebff774d3249', 'ff1b1724-4f6b-4965-a972-888570d01413'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:34 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:34 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:35 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-bdda4921-9ed3-41a9-a0dd-caf153060349-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.832s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-bdda4921-9ed3-41a9-a0dd-caf153060349-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Deleted volume successfully.
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-5fdb7565-f5d5-4815-bec7-6031cb6fc468 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-cc89b342-a3e5-44eb-809c-d10ed1fc4932-delete_volume" released by "delete_volume" :: held 3.531s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b3b3a-6949-4c48-9560-709916f7a709]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:35 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349
Jul 06 13:38:35 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:36 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349" returned: 0 in 1.126s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:36 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349
Jul 06 13:38:36 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:37 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-bdda4921-9ed3-41a9-a0dd-caf153060349" returned: 0 in 0.886s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-quobyte-bdda4921-9ed3-41a9-a0dd-caf153060349" released by "delete_volume" :: held 2.081s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:37 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Created reservations ['27bce030-2774-4a69-b815-bedb679226d2', 'a4d918cc-0053-42f2-b997-087e6c0433bd', '9828611a-3d62-450e-a303-717e93ccffae', 'de7131ad-b8e5-4eeb-8a36-bffad7d97067'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:38 devstack sudo[104800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:38 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:39 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.193s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Deleted volume successfully.
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-30f7ba7c-164b-4b11-9687-50c653a81b21 tempest-VolumeDependencyTests-1992328528 None] Lock "cinder-bdda4921-9ed3-41a9-a0dd-caf153060349-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (d8740b11-bb3a-4fff-b90c-9cb3c6e752f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef534eb3-76ab-4a70-b5ea-128b18633025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef534eb3-76ab-4a70-b5ea-128b18633025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203100442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35080dbe-71d7-4c6b-9c5a-7db745252018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:39Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914ead5a-5290-499f-8cf7-9e1793b79534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914ead5a-5290-499f-8cf7-9e1793b79534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a60e2e-1d29-4f33-bed2-4b73ea4ca4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a60e2e-1d29-4f33-bed2-4b73ea4ca4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35080dbe-71d7-4c6b-9c5a-7db745252018', 'volume_name': 'volume-35080dbe-71d7-4c6b-9c5a-7db745252018', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70608c-a3f1-484b-8044-95564d0211ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d70608c-a3f1-484b-8044-95564d0211ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63940513-6dc2-43ae-af5c-40596dd3cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Volume 35080dbe-71d7-4c6b-9c5a-7db745252018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35080dbe-71d7-4c6b-9c5a-7db745252018', 'volume_size': 1}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-203100442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35080dbe-71d7-4c6b-9c5a-7db745252018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:39Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Creating volume 35080dbe-71d7-4c6b-9c5a-7db745252018 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:39 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:39 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 1073741824
Jul 06 13:38:39 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (7309b285-21ff-48b7-8352-857b773f2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f79e55e-70b2-47eb-bf41-c254470de014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f79e55e-70b2-47eb-bf41-c254470de014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856230659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7169f7-e037-4079-9733-09d8a7a3f90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:40Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e96fe1c-ca90-4db7-9f74-49e8ea952b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e96fe1c-ca90-4db7-9f74-49e8ea952b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf0d129-9d43-4e06-80ba-2da5771e37ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf0d129-9d43-4e06-80ba-2da5771e37ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab7169f7-e037-4079-9733-09d8a7a3f90f', 'volume_name': 'volume-ab7169f7-e037-4079-9733-09d8a7a3f90f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c406c8-c68e-4f29-9b88-fd3ac13e0a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c406c8-c68e-4f29-9b88-fd3ac13e0a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d7c8-89af-4a32-b8fe-cddf9644f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Volume ab7169f7-e037-4079-9733-09d8a7a3f90f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab7169f7-e037-4079-9733-09d8a7a3f90f', 'volume_size': 1}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (e262b4e1-a64a-4c76-b8a9-ca06754dd968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e92e577-11dd-4604-aff1-0db5b6c1bb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e92e577-11dd-4604-aff1-0db5b6c1bb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775672020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9fc13f-626b-46e6-bdfd-23eb9664be67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:41Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4668a-085c-4f15-b43c-ca1810046ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4668a-085c-4f15-b43c-ca1810046ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a0f4f0-079d-4260-b402-6533d0d4e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a0f4f0-079d-4260-b402-6533d0d4e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9fc13f-626b-46e6-bdfd-23eb9664be67', 'volume_name': 'volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:40 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a8ac7-cb5b-4457-8b3f-7fc77c366f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0a8ac7-cb5b-4457-8b3f-7fc77c366f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61a8485-1250-4c64-815d-db85aef38233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Volume 6e9fc13f-626b-46e6-bdfd-23eb9664be67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67', 'volume_size': 1}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:41 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 1073741824" returned: 0 in 1.631s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:41 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018
Jul 06 13:38:41 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (9d33fc15-564e-45eb-814d-2e23efc88c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e442b912-8892-455b-b0d4-5d332319d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e442b912-8892-455b-b0d4-5d332319d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319018058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:42Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205f54d1-d0b5-41b8-870a-7b47c2e42d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205f54d1-d0b5-41b8-870a-7b47c2e42d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4888b6fe-1c50-4ea1-9715-5367e2788a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4888b6fe-1c50-4ea1-9715-5367e2788a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5', 'volume_name': 'volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76632cc6-b557-4c87-9f68-0941a70daf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76632cc6-b557-4c87-9f68-0941a70daf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0318757-3e49-4f71-950e-c78487f3ec28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:41 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Volume 59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5', 'volume_size': 1}
Jul 06 13:38:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (d1de09c3-b414-485c-a9ae-08b3b78d9ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e92207c-1144-4a37-889a-a53a1d6a7b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e92207c-1144-4a37-889a-a53a1d6a7b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368263486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75747146-9b35-45b0-a4c4-6476228fa43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:42Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cf8011-f125-4b76-b2e9-536a8c25c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cf8011-f125-4b76-b2e9-536a8c25c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee46754-2fd0-46ca-bcbf-0196ce002360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee46754-2fd0-46ca-bcbf-0196ce002360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75747146-9b35-45b0-a4c4-6476228fa43c', 'volume_name': 'volume-75747146-9b35-45b0-a4c4-6476228fa43c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac016263-81d3-420a-bf10-a6f0f0aeb5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac016263-81d3-420a-bf10-a6f0f0aeb5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13bb3f8-bedd-41d8-94ec-01156fb1ec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Volume 75747146-9b35-45b0-a4c4-6476228fa43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75747146-9b35-45b0-a4c4-6476228fa43c', 'volume_size': 1}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:42 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Flow 'volume_create_manager' (fe074d6c-2fdf-460a-822b-659d159fbc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c432fd-b9fd-4ffc-8ea0-e275b5229581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018" returned: 0 in 1.382s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] <== create_volume: return (3072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.074s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-856230659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab7169f7-e037-4079-9733-09d8a7a3f90f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:40Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Creating volume ab7169f7-e037-4079-9733-09d8a7a3f90f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:42 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c432fd-b9fd-4ffc-8ea0-e275b5229581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2fc494-db87-4058-855e-c3be70ff301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a15c5afa3e7499b923fe1ccfb20a25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:43Z,use_quota=True,user_id='919325e60a5045608bb45f735089b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4efc3e6-c171-41fb-99e2-4f78bfdee4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f 1073741824
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4efc3e6-c171-41fb-99e2-4f78bfdee4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749addf-53e1-42f2-b374-07ba71da7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.image.glance [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Creating Keystone auth plugin from conf {{(pid=86698) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63940513-6dc2-43ae-af5c-40596dd3cb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35080dbe-71d7-4c6b-9c5a-7db745252018', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b79aad-ed71-47ac-a0d1-68b39d52d917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:42 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Volume volume-35080dbe-71d7-4c6b-9c5a-7db745252018 (35080dbe-71d7-4c6b-9c5a-7db745252018): created successfully
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b79aad-ed71-47ac-a0d1-68b39d52d917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:42 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (d8740b11-bb3a-4fff-b90c-9cb3c6e752f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8153ab9a-e3e2-4100-9261-6327250b90a2 tempest-CreateVolumesFromImageTest-74958837 None] Created volume successfully.
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a749addf-53e1-42f2-b374-07ba71da7550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b2fc494-db87-4058-855e-c3be70ff301d', 'volume_name': 'volume-8b2fc494-db87-4058-855e-c3be70ff301d', 'volume_size': 1, 'image_id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d0513d4d3adfaf0bf57dc27171f902', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a15c5afa3e7499b923fe1ccfb20a25f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e734c0f21ac50c529f95b3b1bb06848d955218963d89c995eba38da52651b2b18a76bb2cc2cec39cddf079236bd4cf27a6463b813507b15c092aa49c1ef9dd9', 'id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'created_at': datetime.datetime(2026, 7, 6, 11, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9975172c-b243-4fb9-8672-68bb541ed76d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359971d3a0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868fe410-edaa-454a-b097-1e407c8ea69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868fe410-edaa-454a-b097-1e407c8ea69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d448df05-517f-491e-bbc9-1f2a31a0768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Volume 8b2fc494-db87-4058-855e-c3be70ff301d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b2fc494-db87-4058-855e-c3be70ff301d', 'volume_size': 1, 'image_id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d0513d4d3adfaf0bf57dc27171f902', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a15c5afa3e7499b923fe1ccfb20a25f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e734c0f21ac50c529f95b3b1bb06848d955218963d89c995eba38da52651b2b18a76bb2cc2cec39cddf079236bd4cf27a6463b813507b15c092aa49c1ef9dd9', 'id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'created_at': datetime.datetime(2026, 7, 6, 11, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9975172c-b243-4fb9-8672-68bb541ed76d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359971d3a0>}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Trying to clone 8b2fc494-db87-4058-855e-c3be70ff301d from image 9975172c-b243-4fb9-8672-68bb541ed76d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}]). {{(pid=86698) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Flow 'volume_create_manager' (d9bc8d7d-6e43-4d3d-a3e6-92d6dcab2fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4b8e04-7d6d-4f69-b98b-3dc74795c61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4b8e04-7d6d-4f69-b98b-3dc74795c61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1644166410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89757e4b-3947-4beb-b1ab-248548fe8fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cc3baabc34c7a949117d0eeac1ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:43Z,use_quota=True,user_id='7f0e84022ee44081a02f2807cb964620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e2a541-f7d7-47d5-8718-6d9b833806e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e2a541-f7d7-47d5-8718-6d9b833806e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b781bc0-f649-4272-8454-7d3e8a98e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b781bc0-f649-4272-8454-7d3e8a98e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89757e4b-3947-4beb-b1ab-248548fe8fb3', 'volume_name': 'volume-89757e4b-3947-4beb-b1ab-248548fe8fb3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cfc9c3-d31e-4717-bac3-636215ae8bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cfc9c3-d31e-4717-bac3-636215ae8bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe46651b-5728-4892-b04a-a0ccdfffd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:43 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Volume 89757e4b-3947-4beb-b1ab-248548fe8fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89757e4b-3947-4beb-b1ab-248548fe8fb3', 'volume_size': 1}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 13:38:43 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f27aca-e359-4f3b-bf48-5831eea83ae3]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:43 devstack sudo[104818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:43 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:43 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f 1073741824" returned: 0 in 1.156s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:43 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f
Jul 06 13:38:43 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Flow 'volume_create_manager' (218bd8ee-e4ec-49a5-9aa2-a84ff6077ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08ffa82-eca4-4db3-8014-944c19c8e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08ffa82-eca4-4db3-8014-944c19c8e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28bc123-d021-426e-9edc-2907a142cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdd227766ca4fb39fd0ef90e005dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:44Z,use_quota=True,user_id='7a80a78f80f540fda2617bbb421e8563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3420bf1c-2301-4bfc-89b3-0463bd8572f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3420bf1c-2301-4bfc-89b3-0463bd8572f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c8be7-b04f-476b-8a0e-998cfc0f6769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4c8be7-b04f-476b-8a0e-998cfc0f6769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28bc123-d021-426e-9edc-2907a142cb3d', 'volume_name': 'volume-a28bc123-d021-426e-9edc-2907a142cb3d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0a3886-038d-4516-b9ab-4fc32deecaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0a3886-038d-4516-b9ab-4fc32deecaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a56af31-7d07-4037-84ae-55cff4c77f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Volume a28bc123-d021-426e-9edc-2907a142cb3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28bc123-d021-426e-9edc-2907a142cb3d', 'volume_size': 1}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:44 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:44 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:44 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:44 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f" returned: 0 in 0.729s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.635s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-775672020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9fc13f-626b-46e6-bdfd-23eb9664be67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:41Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Creating volume 6e9fc13f-626b-46e6-bdfd-23eb9664be67 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:44 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:44 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 1073741824
Jul 06 13:38:44 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d7c8-89af-4a32-b8fe-cddf9644f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab7169f7-e037-4079-9733-09d8a7a3f90f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d784673-9b05-40d7-bcda-733fafcaf7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:44 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Volume volume-ab7169f7-e037-4079-9733-09d8a7a3f90f (ab7169f7-e037-4079-9733-09d8a7a3f90f): created successfully
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d784673-9b05-40d7-bcda-733fafcaf7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (7309b285-21ff-48b7-8352-857b773f2db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d0ac39b9-61bc-430d-b226-8688567fbb07 tempest-CreateVolumesFromImageTest-74958837 None] Created volume successfully.
Jul 06 13:38:45 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 1 in 0.795s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Temporary image 9975172c-b243-4fb9-8672-68bb541ed76d is fetched for user 919325e60a5045608bb45f735089b8b2. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a8f6e6-31fd-4279-ab6c-509f6963fd18]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:45 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:45 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:45 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 1073741824" returned: 0 in 0.902s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:45 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67
Jul 06 13:38:45 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:46 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:46 devstack sudo[104844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:46 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:46 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67" returned: 0 in 0.645s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.364s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1319018058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:42Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Creating volume 59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:46 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:46 devstack sudo[104847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 1073741824
Jul 06 13:38:46 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61a8485-1250-4c64-815d-db85aef38233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b3ac50-4460-4539-b057-46c01b79faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Volume volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 (6e9fc13f-626b-46e6-bdfd-23eb9664be67): created successfully
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b3ac50-4460-4539-b057-46c01b79faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (e262b4e1-a64a-4c76-b8a9-ca06754dd968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=91,cinder:UPDATE=116,cinder:INSERT=30,cinder:DELETE=13 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:38:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9f112d58-59be-468a-bb3d-2ed7af2e4b27 tempest-CreateVolumesFromImageTest-74958837 None] Created volume successfully.
Jul 06 13:38:46 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:47 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 1073741824" returned: 0 in 0.828s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=121,cinder:SELECT=90,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:47 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5
Jul 06 13:38:47 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:47 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" returned: 0 in 0.685s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.346s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1368263486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75747146-9b35-45b0-a4c4-6476228fa43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3be0c32e86b48cea66c3c9852e7a51a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:42Z,use_quota=True,user_id='7e66fe09aae64f95890006e63994b674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Creating volume 75747146-9b35-45b0-a4c4-6476228fa43c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:47 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:47 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c 1073741824
Jul 06 13:38:47 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0318757-3e49-4f71-950e-c78487f3ec28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38db636c-c62e-41f9-b3df-807f6cbf6565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:47 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Volume volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 (59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5): created successfully
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38db636c-c62e-41f9-b3df-807f6cbf6565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (9d33fc15-564e-45eb-814d-2e23efc88c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:47 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-69ec670e-2000-4b2f-8e10-d9aca8609cd6 tempest-CreateVolumesFromImageTest-74958837 None] Created volume successfully.
Jul 06 13:38:48 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c 1073741824" returned: 0 in 0.822s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:48 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c
Jul 06 13:38:48 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:49 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c" returned: 0 in 0.665s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.861s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1644166410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89757e4b-3947-4beb-b1ab-248548fe8fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cc3baabc34c7a949117d0eeac1ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:43Z,use_quota=True,user_id='7f0e84022ee44081a02f2807cb964620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Creating volume 89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:49 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a13bb3f8-bedd-41d8-94ec-01156fb1ec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75747146-9b35-45b0-a4c4-6476228fa43c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:49 devstack sudo[104867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 1073741824
Jul 06 13:38:49 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e64fa81-fe0d-46c5-9b27-b1afe7a0ac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:49 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Volume volume-75747146-9b35-45b0-a4c4-6476228fa43c (75747146-9b35-45b0-a4c4-6476228fa43c): created successfully
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e64fa81-fe0d-46c5-9b27-b1afe7a0ac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:49 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Flow 'volume_create_manager' (d1de09c3-b414-485c-a9ae-08b3b78d9ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:49 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-607e32f8-99d4-46d9-8389-fd580300f580 tempest-CreateVolumesFromImageTest-74958837 None] Created volume successfully.
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-75747146-9b35-45b0-a4c4-6476228fa43c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-75747146-9b35-45b0-a4c4-6476228fa43c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-quobyte-75747146-9b35-45b0-a4c4-6476228fa43c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-75747146-9b35-45b0-a4c4-6476228fa43c" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c059b62-1dca-4622-b2e5-8f5a243bcb1c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:50 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c
Jul 06 13:38:50 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:50 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 1073741824" returned: 0 in 0.905s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:50 devstack sudo[104875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:38:50 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:50 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:50 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:50 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c
Jul 06 13:38:50 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 0.671s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.862s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28bc123-d021-426e-9edc-2907a142cb3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdd227766ca4fb39fd0ef90e005dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:44Z,use_quota=True,user_id='7a80a78f80f540fda2617bbb421e8563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Creating volume a28bc123-d021-426e-9edc-2907a142cb3d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:51 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:51 devstack sudo[104883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d 1073741824
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe46651b-5728-4892-b04a-a0ccdfffd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89757e4b-3947-4beb-b1ab-248548fe8fb3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:51 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1927c342-21d8-45a4-a47c-14e648f461f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:51 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Volume volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 (89757e4b-3947-4beb-b1ab-248548fe8fb3): created successfully
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1927c342-21d8-45a4-a47c-14e648f461f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Flow 'volume_create_manager' (d9bc8d7d-6e43-4d3d-a3e6-92d6dcab2fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e1703bdf-d296-496b-89dc-52a705b786a7 tempest-SnapshotDependencyTests-471438683 None] Created volume successfully.
Jul 06 13:38:51 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-75747146-9b35-45b0-a4c4-6476228fa43c" returned: 0 in 0.649s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-75747146-9b35-45b0-a4c4-6476228fa43c" released by "delete_volume" :: held 1.492s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Created reservations ['fbec1af4-5fa8-46d0-a807-52d5d0126ef2', 'fc922887-4ddf-4a34-8ba4-290fa459143e', '0924d166-d484-4530-a9e5-dc9c237ad59a', 'ce78f8a4-d80e-4abb-b6a1-20758e3e8d0f'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:51 devstack sudo[104890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:51 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:51 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d 1073741824" returned: 0 in 0.986s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:52 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d
Jul 06 13:38:52 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-quobyte-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4530941-04dc-4847-ae92-990ba06dfee8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:52 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.778s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Deleted volume successfully.
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-87f282cb-a567-4c32-8a45-46e67e0c3aac tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-75747146-9b35-45b0-a4c4-6476228fa43c-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:52 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5
Jul 06 13:38:52 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:52 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d" returned: 0 in 0.802s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2fc494-db87-4058-855e-c3be70ff301d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a15c5afa3e7499b923fe1ccfb20a25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:43Z,use_quota=True,user_id='919325e60a5045608bb45f735089b8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Creating volume 8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:52 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:52 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1073741824
Jul 06 13:38:52 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a56af31-7d07-4037-84ae-55cff4c77f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28bc123-d021-426e-9edc-2907a142cb3d', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6b8e9a-b709-44fe-b628-731bc3675f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:52 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Volume volume-a28bc123-d021-426e-9edc-2907a142cb3d (a28bc123-d021-426e-9edc-2907a142cb3d): created successfully
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a6b8e9a-b709-44fe-b628-731bc3675f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Flow 'volume_create_manager' (218bd8ee-e4ec-49a5-9aa2-a84ff6077ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8b5e96a7-99ad-48e6-9ab0-fbffc781777f tempest-CinderUnicodeTest-389954049 None] Created volume successfully.
Jul 06 13:38:53 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" returned: 0 in 0.827s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:53 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5
Jul 06 13:38:53 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:53 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1073741824" returned: 0 in 0.993s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:53 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:38:53 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:53 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" returned: 0 in 0.688s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5" released by "delete_volume" :: held 1.570s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Created reservations ['6708329f-7777-4316-bbe4-37f13a988ae4', '710dafe5-3dd0-42ef-887b-af26f665142d', '137541a3-230c-4b87-86f1-1471dc258b7e', '2f1c598f-fed2-4378-a420-6bc59b071162'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:54 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:54 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Flow 'volume_create_manager' (8a3f9147-adc4-4b63-ab71-5807b9734daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215345f6-9ce9-4b41-986b-f27bafab7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215345f6-9ce9-4b41-986b-f27bafab7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-742713587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760087d2-a5cb-4d55-be95-214210bad537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdd227766ca4fb39fd0ef90e005dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:54Z,use_quota=True,user_id='7a80a78f80f540fda2617bbb421e8563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6979c4-8e94-43af-a9fe-28a030070efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6979c4-8e94-43af-a9fe-28a030070efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe565f8f-7da7-462a-8e35-04df8b8da745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe565f8f-7da7-462a-8e35-04df8b8da745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760087d2-a5cb-4d55-be95-214210bad537', 'volume_name': 'volume-760087d2-a5cb-4d55-be95-214210bad537', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41b0fe8-73a4-442f-bbd7-13babf7ea56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41b0fe8-73a4-442f-bbd7-13babf7ea56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b7eba5-9b17-469f-86e6-6b206cee28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:38:54 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Volume 760087d2-a5cb-4d55-be95-214210bad537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760087d2-a5cb-4d55-be95-214210bad537', 'volume_size': 1}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-6e9fc13f-626b-46e6-bdfd-23eb9664be67-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-6e9fc13f-626b-46e6-bdfd-23eb9664be67-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-quobyte-6e9fc13f-626b-46e6-bdfd-23eb9664be67" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:54 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-6e9fc13f-626b-46e6-bdfd-23eb9664be67" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.516s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b2667a-1cf8-41c7-8c3a-51ef29f22c29]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Creating offline snapshot da067bd6-8afb-45e9-b220-0c6675da874c of volume 89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f732352d-7113-40e1-8fef-df21fb9a31f5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Attempting download of 9975172c-b243-4fb9-8672-68bb541ed76d ((None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}])) to volume 8b2fc494-db87-4058-855e-c3be70ff301d. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:54 devstack sudo[104916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67
Jul 06 13:38:54 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa0462-955f-45ca-9a21-f2bea9851edd]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:54 devstack sudo[104917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:38:54 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:54 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.763s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Deleted volume successfully.
Jul 06 13:38:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-34340b0c-2d52-4739-a782-3ec6a948fd71 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-59a3dc7d-6ec3-499f-bb93-bb8d2fd3b5f5-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:54 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go
Jul 06 13:38:54 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:55 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67" returned: 0 in 0.867s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:55 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67
Jul 06 13:38:55 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:55 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 0.857s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:55 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go" returned: 0 in 0.798s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:55 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c 1G
Jul 06 13:38:55 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:55 devstack sudo[104934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go
Jul 06 13:38:55 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:56 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6e9fc13f-626b-46e6-bdfd-23eb9664be67" returned: 0 in 0.720s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-6e9fc13f-626b-46e6-bdfd-23eb9664be67" released by "delete_volume" :: held 1.639s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Created reservations ['47f76bb0-79fb-40a9-b642-48c106e0b0d9', '21d63e7b-f7ae-44b9-869c-18845e575b54', 'f945c2af-63ce-4f0f-92df-014273ded45e', 'cd21e479-821d-487b-b44e-feec51ee6342'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:56 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go" returned: 1 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9975172c-b243-4fb9-8672-68bb541ed76d_vk7jm6go' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52b65f-43a5-4bc2-a79d-958c83554cff]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:56 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:56 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:56 devstack sudo[104944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:56 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:56 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c 1G" returned: 0 in 0.939s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:56 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:38:56 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-ab7169f7-e037-4079-9733-09d8a7a3f90f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-ab7169f7-e037-4079-9733-09d8a7a3f90f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-quobyte-ab7169f7-e037-4079-9733-09d8a7a3f90f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-ab7169f7-e037-4079-9733-09d8a7a3f90f" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4505b1b1-0758-44d5-be6f-af5bffcf7b58]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:57 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f
Jul 06 13:38:57 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:57 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:57 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.855s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Deleted volume successfully.
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6e6be1e2-81f2-41f5-bfb3-408133e19e2f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-6e9fc13f-626b-46e6-bdfd-23eb9664be67-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:57 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 0.823s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:57 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c is being set with open permissions: ugo+rw
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:57 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:38:57 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:57 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD
Jul 06 13:38:57 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:57 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f" returned: 0 in 0.845s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:57 devstack sudo[104965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f
Jul 06 13:38:57 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:58 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 0.683s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:58 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] 9975172c-b243-4fb9-8672-68bb541ed76d was raw, converting to raw {{(pid=86698) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 13:38:58 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info
Jul 06 13:38:58 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:58 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:38:58 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:58 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ab7169f7-e037-4079-9733-09d8a7a3f90f" returned: 0 in 0.736s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-ab7169f7-e037-4079-9733-09d8a7a3f90f" released by "delete_volume" :: held 1.632s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Created reservations ['2014a565-da57-4bb0-9c11-aaf2f75e96b4', 'ca71ffd4-77cc-4f97-9f5c-38c94ec25952', '4ac8c073-301d-4102-b6e6-9970e91ca611', 'fb864e63-415d-42d3-8c9e-0dfd711c83af'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:58 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info" returned: 0 in 0.692s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:58 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info is being set with open permissions: ugo+rw
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:58 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:38:58 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:58 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info
Jul 06 13:38:58 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:58 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 0 in 0.814s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9975172c-b243-4fb9-8672-68bb541ed76d_q550zalgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:38:58 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 13:38:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:59 devstack sudo[104984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1G
Jul 06 13:38:59 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-35080dbe-71d7-4c6b-9c5a-7db745252018-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-35080dbe-71d7-4c6b-9c5a-7db745252018-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "cinder-quobyte-35080dbe-71d7-4c6b-9c5a-7db745252018" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-35080dbe-71d7-4c6b-9c5a-7db745252018" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c078c67-2b1f-42cc-81b8-9ed9a0c92770]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:59 devstack sudo[104986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018
Jul 06 13:38:59 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:59 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.info" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:59 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.846s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.228s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:38:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-742713587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760087d2-a5cb-4d55-be95-214210bad537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bdd227766ca4fb39fd0ef90e005dab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:38:54Z,use_quota=True,user_id='7a80a78f80f540fda2617bbb421e8563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Creating volume 760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:38:59 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.802s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:38:59 devstack sudo[104990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 1073741824
Jul 06 13:38:59 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:38:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Deleted volume successfully.
Jul 06 13:38:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1fc1c89e-d697-4644-9539-c20987b555ac tempest-SnapshotDependencyTests-471438683 None] Create snapshot completed successfully
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2daaf9a3-9905-4f1c-acf0-b72d5e555802 tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-ab7169f7-e037-4079-9733-09d8a7a3f90f-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:38:59 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d 1G" returned: 0 in 0.839s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b03205-607d-49b5-9d5c-e311dbef67e7]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:38:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:38:59 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:38:59 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:00 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:00 devstack sudo[105001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018
Jul 06 13:39:00 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:00 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 1073741824" returned: 0 in 1.005s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:00 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537
Jul 06 13:39:00 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:00 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 0 in 0.960s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:00 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-35080dbe-71d7-4c6b-9c5a-7db745252018" returned: 0 in 0.751s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-quobyte-35080dbe-71d7-4c6b-9c5a-7db745252018" released by "delete_volume" :: held 1.646s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:00 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:39:00 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Created reservations ['ff96c1fc-3549-41e5-a488-c0e0f614b9a5', 'd9242fb5-b03c-4f15-866a-a5f09983868f', 'b82dae06-e92a-4340-af1b-5ad3ae476cb3', 'b6b077e0-2035-4940-b5e4-620a9f358312'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:01 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:01 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:01 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Flow 'volume_create_manager' (c3fa4e0a-64dc-42cf-b7a4-95f70e28bcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f5ab9e-cf3c-44af-b0ac-0a2c86230ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537" returned: 0 in 0.909s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18f5ab9e-cf3c-44af-b0ac-0a2c86230ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff3a27e-7509-40f0-b32d-c342f7b63b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b0cc3baabc34c7a949117d0eeac1ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da067bd6-8afb-45e9-b220-0c6675da874c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:01Z,use_quota=True,user_id='7f0e84022ee44081a02f2807cb964620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138cb931-12b5-4c45-a51c-93d8c3df27b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138cb931-12b5-4c45-a51c-93d8c3df27b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30691087-da81-4f9c-bdf9-c0eb43377403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30691087-da81-4f9c-bdf9-c0eb43377403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0ff3a27e-7509-40f0-b32d-c342f7b63b49', 'volume_name': 'volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49', 'volume_size': 1, 'snapshot_id': 'da067bd6-8afb-45e9-b220-0c6675da874c'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a29081-99a9-4aae-a2bd-c297970060b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a29081-99a9-4aae-a2bd-c297970060b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dbf639-52e3-4df7-a545-36e76da01551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Volume 0ff3a27e-7509-40f0-b32d-c342f7b63b49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49', 'volume_size': 1, 'snapshot_id': 'da067bd6-8afb-45e9-b220-0c6675da874c'}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b7eba5-9b17-469f-86e6-6b206cee28ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760087d2-a5cb-4d55-be95-214210bad537', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56d913f-96e1-495a-b6dd-4d03027b6f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c-0ff3a27e-7509-40f0-b32d-c342f7b63b49" by "_create_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Volume volume-760087d2-a5cb-4d55-be95-214210bad537 (760087d2-a5cb-4d55-be95-214210bad537): created successfully
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d56d913f-96e1-495a-b6dd-4d03027b6f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Flow 'volume_create_manager' (8a3f9147-adc4-4b63-ab71-5807b9734daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c-0ff3a27e-7509-40f0-b32d-c342f7b63b49" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Creating volume 0ff3a27e-7509-40f0-b32d-c342f7b63b49 from snapshot da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" by "_copy_volume_from_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:01 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-eecb54c3-a5b7-4be3-ae10-7d069ceb132b tempest-CinderUnicodeTest-389954049 None] Created volume successfully.
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] snapshot: da067bd6-8afb-45e9-b220-0c6675da874c, volume: 0ff3a27e-7509-40f0-b32d-c342f7b63b49,  {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:01 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 1 in 1.019s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Downloaded image 9975172c-b243-4fb9-8672-68bb541ed76d ((None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}])) to volume 8b2fc494-db87-4058-855e-c3be70ff301d successfully. {{(pid=86698) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Temporary image 9975172c-b243-4fb9-8672-68bb541ed76d for user 919325e60a5045608bb45f735089b8b2 is deleted. {{(pid=86698) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.volume_utils [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Marking volume 8b2fc494-db87-4058-855e-c3be70ff301d as bootable. {{(pid=86698) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfd987d-49c5-43f6-aa89-b10b03ec3061]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Copying metadata from image 9975172c-b243-4fb9-8672-68bb541ed76d to 8b2fc494-db87-4058-855e-c3be70ff301d. {{(pid=86698) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Creating volume glance metadata for volume 8b2fc494-db87-4058-855e-c3be70ff301d backed by image 9975172c-b243-4fb9-8672-68bb541ed76d with: {'image_id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '11d0513d4d3adfaf0bf57dc27171f902', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86698) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d448df05-517f-491e-bbc9-1f2a31a0768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2fc494-db87-4058-855e-c3be70ff301d', 'volume_size': 1, 'image_id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9975172c-b243-4fb9-8672-68bb541ed76d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '11d0513d4d3adfaf0bf57dc27171f902', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6a15c5afa3e7499b923fe1ccfb20a25f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1e734c0f21ac50c529f95b3b1bb06848d955218963d89c995eba38da52651b2b18a76bb2cc2cec39cddf079236bd4cf27a6463b813507b15c092aa49c1ef9dd9', 'id': '9975172c-b243-4fb9-8672-68bb541ed76d', 'created_at': datetime.datetime(2026, 7, 6, 11, 38, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 11, 38, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9975172c-b243-4fb9-8672-68bb541ed76d/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72359971d3a0>}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e6b49c-0851-456f-b1a0-9ecb74ae6ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:01 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Volume volume-8b2fc494-db87-4058-855e-c3be70ff301d (8b2fc494-db87-4058-855e-c3be70ff301d): created successfully
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e6b49c-0851-456f-b1a0-9ecb74ae6ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:01 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Flow 'volume_create_manager' (fe074d6c-2fdf-460a-822b-659d159fbc5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7d7d2d1a-a63b-4beb-89a9-b1299a600742 tempest-VolumeImageDependencyTests-103477084 None] Created volume successfully.
Jul 06 13:39:02 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:39:02 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:02 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.972s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Deleted volume successfully.
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4294ba3a-f8ef-4812-b171-b2bffa6d806f tempest-CreateVolumesFromImageTest-74958837 None] Lock "cinder-35080dbe-71d7-4c6b-9c5a-7db745252018-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:02 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 0.912s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89757e4b-3947-4beb-b1ab-248548fe8fb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Creating direct copy from snapshot {{(pid=86698) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[027d0b4e-0faa-40e2-ac65-4fd6efb4aea4]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:02 devstack sudo[105025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:39:02 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Acquiring lock "cinder-8b2fc494-db87-4058-855e-c3be70ff301d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "cinder-8b2fc494-db87-4058-855e-c3be70ff301d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Acquiring lock "cinder-quobyte-8b2fc494-db87-4058-855e-c3be70ff301d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "cinder-quobyte-8b2fc494-db87-4058-855e-c3be70ff301d" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a9358e-ef40-4613-899f-f88efccaea35]: (4, 'raw') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:03 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:39:03 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:03 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 1.144s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG cinder.utils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Path /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 not found in is_blk_device check {{(pid=86698) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 13:39:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:03 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49
Jul 06 13:39:03 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:04 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 0 in 0.842s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:04 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:39:04 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:06 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 1 in 1.724s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d' failed. Not Retrying. {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:06 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d
Jul 06 13:39:06 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (692014ec-2871-48f8-97ad-f2a4d2247d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782d175f-4ec6-4468-b3f1-170917a4fcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782d175f-4ec6-4468-b3f1-170917a4fcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591955733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:06Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee09a50-8c54-4ad2-8aca-d4782c9cd42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee09a50-8c54-4ad2-8aca-d4782c9cd42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f965e0b1-33d5-4109-a532-99384148964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f965e0b1-33d5-4109-a532-99384148964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a', 'volume_name': 'volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd346c8-15f1-4d16-8c5d-ac17f44a3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd346c8-15f1-4d16-8c5d-ac17f44a3145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b4bdc9-de32-4d59-836b-2fc869b9128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume 89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a', 'volume_size': 1}
Jul 06 13:39:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:07 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8b2fc494-db87-4058-855e-c3be70ff301d" returned: 0 in 1.299s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "cinder-quobyte-8b2fc494-db87-4058-855e-c3be70ff301d" released by "delete_volume" :: held 3.964s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Created reservations ['ddd8d680-670a-45b9-99b2-a1da4a700882', 'ee9ccfab-559e-42b0-8a60-4101fa35dae1', '4293bd3a-0ff6-4b17-af0e-afb2eac7ea30', 'f681635c-f036-49c0-8136-71b0475f0dca'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:07 devstack sudo[105057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:07 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:08 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.980s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:08 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Deleted volume successfully.
Jul 06 13:39:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-384d2b07-b006-4c56-a102-dffbc69e25cd tempest-VolumeImageDependencyTests-103477084 None] Lock "cinder-8b2fc494-db87-4058-855e-c3be70ff301d-delete_volume" released by "delete_volume" :: held 5.374s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:09 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49" returned: 0 in 5.637s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[92711cde-3fe8-49e2-91c8-1ded8d4e86a2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:09 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:39:09 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:10 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 1.027s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:10 devstack cinder-volume[86698]: DEBUG cinder.image.image_utils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Image conversion details: src /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 {{(pid=86698) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 13:39:10 devstack cinder-volume[86698]: INFO cinder.image.image_utils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Converted 1024.00 MB image at 181.64 MB/s
Jul 06 13:39:10 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 is being set with open permissions: ugo+rw
Jul 06 13:39:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:10 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49
Jul 06 13:39:10 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:11 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49" returned: 0 in 0.694s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" released by "_copy_volume_from_snapshot" :: held 9.548s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c-0ff3a27e-7509-40f0-b32d-c342f7b63b49" released by "_create_volume_from_snapshot" :: held 9.633s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.684s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.973s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Creating offline snapshot 1aabb1ff-0240-45e6-aa75-763cc370a2ef of volume 760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e54fd-3d9f-4b91-b87d-d4f39d359cf5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dbf639-52e3-4df7-a545-36e76da01551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49', 'volume_size': 1, 'snapshot_id': 'da067bd6-8afb-45e9-b220-0c6675da874c'}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc05d7-95bf-4720-9197-86a53a1f52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Volume volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 (0ff3a27e-7509-40f0-b32d-c342f7b63b49): created successfully
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc05d7-95bf-4720-9197-86a53a1f52d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Flow 'volume_create_manager' (c3fa4e0a-64dc-42cf-b7a4-95f70e28bcda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b748a577-0b00-4dd7-9a5d-9eea4f0951f1 tempest-SnapshotDependencyTests-471438683 None] Created volume successfully.
Jul 06 13:39:11 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537
Jul 06 13:39:11 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:12 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537" returned: 0 in 0.788s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:12 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef 1G
Jul 06 13:39:12 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-da067bd6-8afb-45e9-b220-0c6675da874c-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-da067bd6-8afb-45e9-b220-0c6675da874c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Deleting offline snapshot da067bd6-8afb-45e9-b220-0c6675da874c of volume 89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] snapshot_file for this snap is: volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a27297-12bb-4c76-8423-c9628b6b0170]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:12 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:39:12 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:13 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef 1G" returned: 0 in 1.013s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760087d2-a5cb-4d55-be95-214210bad537 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:13 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760087d2-a5cb-4d55-be95-214210bad537 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef
Jul 06 13:39:13 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:13 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89757e4b-3947-4beb-b1ab-248548fe8fb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18742cb-a418-4e82-be9f-975a738a5c6f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:13 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:39:13 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:13 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760087d2-a5cb-4d55-be95-214210bad537 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef" returned: 0 in 0.735s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:13 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef is being set with open permissions: ugo+rw
Jul 06 13:39:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:13 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef
Jul 06 13:39:13 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:14 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:14 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:39:14 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:14 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef" returned: 0 in 0.683s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:14 devstack sudo[105102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info
Jul 06 13:39:14 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:15 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 1.000s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:15 devstack sudo[105143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c
Jul 06 13:39:15 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:15 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info" returned: 0 in 0.906s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:15 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info is being set with open permissions: ugo+rw
Jul 06 13:39:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:15 devstack sudo[105146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info
Jul 06 13:39:15 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:16 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3.da067bd6-8afb-45e9-b220-0c6675da874c" returned: 0 in 0.857s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-da067bd6-8afb-45e9-b220-0c6675da874c" released by "_delete_snapshot" :: held 3.648s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" released by "delete_snapshot" :: held 3.678s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Created reservations ['4ae6b91d-03bf-4abf-9f24-e1b857012728', '3efebba3-98a5-4129-99e9-83e6faa88110', '4cdba05f-17c2-435a-a8be-8ee4c40d7e6a', '5f323a6f-1845-4c2d-a844-9311be0ee822'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Delete snapshot completed successfully.
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b4ba8d8e-1191-4233-b50e-c8bf8bf668c0 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-da067bd6-8afb-45e9-b220-0c6675da874c-delete_snapshot" released by "delete_snapshot" :: held 3.848s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:16 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.info" returned: 0 in 0.762s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.042s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591955733',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:06Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume 89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:16 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:16 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a 1073741824
Jul 06 13:39:16 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:16 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f1b26234-9df3-4b42-8e4a-888488f675e7 tempest-CinderUnicodeTest-389954049 None] Create snapshot completed successfully
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-89757e4b-3947-4beb-b1ab-248548fe8fb3-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-89757e4b-3947-4beb-b1ab-248548fe8fb3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" acquired by "delete_volume" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[429cede1-fd86-4c30-a262-a065b04c20d2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:17 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:39:17 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-1aabb1ff-0240-45e6-aa75-763cc370a2ef-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-1aabb1ff-0240-45e6-aa75-763cc370a2ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-quobyte-1aabb1ff-0240-45e6-aa75-763cc370a2ef" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-1aabb1ff-0240-45e6-aa75-763cc370a2ef" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Deleting offline snapshot 1aabb1ff-0240-45e6-aa75-763cc370a2ef of volume 760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] snapshot_file for this snap is: volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c67ec12-7593-40df-a5f8-2668cca3fe91]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:17 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a 1073741824" returned: 0 in 1.102s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:17 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef
Jul 06 13:39:17 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:17 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a
Jul 06 13:39:17 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:17 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 0.933s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:17 devstack sudo[105165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3
Jul 06 13:39:17 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:18 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef" returned: 0 in 0.920s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760087d2-a5cb-4d55-be95-214210bad537(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d6985-9c0a-4572-968a-d0340e75200e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:18 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" returned: 0 in 0.849s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b4bdc9-de32-4d59-836b-2fc869b9128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e68e01-cac5-44fb-a07b-939b2b447205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a (89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a): created successfully
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e68e01-cac5-44fb-a07b-939b2b447205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (692014ec-2871-48f8-97ad-f2a4d2247d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-639d8a15-f3de-4cb3-8893-02396c0aae5c tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:18 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537
Jul 06 13:39:18 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:18 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:18 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:18 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89757e4b-3947-4beb-b1ab-248548fe8fb3" returned: 0 in 0.801s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-89757e4b-3947-4beb-b1ab-248548fe8fb3" released by "delete_volume" :: held 1.820s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Created reservations ['5842a2dc-4be0-4652-b6e2-9a20ce5141bd', '45602a3b-d799-4c02-8e1a-2faaec9e5149', 'b07671c3-c7b6-4746-88af-170b0a356479', 'faab96fc-5205-408e-ae77-ee190a9da7c4'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:18 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:18 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-0ff3a27e-7509-40f0-b32d-c342f7b63b49-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-0ff3a27e-7509-40f0-b32d-c342f7b63b49-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:19 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5e1e1-e2e8-4131-86a6-4ff66b9f97b7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating offline snapshot cf1fb13f-acc7-48ed-a75c-b0217c9bc81e of volume 89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.912s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3ddf37-c580-4781-8f79-4f6a7ddf1608]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:19 devstack sudo[105188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49
Jul 06 13:39:19 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:19 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537" returned: 0 in 1.190s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:19 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef
Jul 06 13:39:19 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:19 devstack sudo[105189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a
Jul 06 13:39:19 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:19 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.077s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:19 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Deleted volume successfully.
Jul 06 13:39:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-f72f9b4d-d2d6-4c69-8be5-deb4ea99c307 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-89757e4b-3947-4beb-b1ab-248548fe8fb3-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:20 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49" returned: 0 in 1.130s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:20 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49
Jul 06 13:39:20 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:20 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef" returned: 0 in 1.016s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:20 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" returned: 0 in 1.134s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:20 devstack sudo[105206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef
Jul 06 13:39:20 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:20 devstack sudo[105207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e 1G
Jul 06 13:39:20 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:21 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0ff3a27e-7509-40f0-b32d-c342f7b63b49" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-quobyte-0ff3a27e-7509-40f0-b32d-c342f7b63b49" released by "delete_volume" :: held 1.956s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:21 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537.1aabb1ff-0240-45e6-aa75-763cc370a2ef" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-1aabb1ff-0240-45e6-aa75-763cc370a2ef" released by "_delete_snapshot" :: held 3.996s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" released by "delete_snapshot" :: held 4.027s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Created reservations ['6e297b9f-8cad-4165-adb1-f65f66c60734', 'bbee435b-1e37-4273-a6c1-dbaa548823a0', 'bc03f69a-62d0-4a8c-b79f-a45e9e8334ed', '1c3784b4-5f44-4f72-ba6f-514e312bba2e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Created reservations ['ca7a0b0f-9dbc-4d73-b33a-21799e51ee98', '0fe0ae65-9dcd-450f-8c12-cfeb10da432c', '34ad01ad-fbe3-42f3-a77c-aa8026ac2b37', 'c2d2477e-cdf5-42f5-a5ee-2129026e17e4'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:21 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e 1G" returned: 0 in 0.939s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:21 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:21 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:21 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e
Jul 06 13:39:21 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Delete snapshot completed successfully.
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-36f5daae-759e-4bf9-b8c2-b61ec2705908 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-1aabb1ff-0240-45e6-aa75-763cc370a2ef-delete_snapshot" released by "delete_snapshot" :: held 4.282s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-760087d2-a5cb-4d55-be95-214210bad537-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-760087d2-a5cb-4d55-be95-214210bad537-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248c169-513c-4116-a9d9-c6e0ab466f80]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:21 devstack sudo[105220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537
Jul 06 13:39:21 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:22 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" returned: 0 in 0.880s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:22 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e is being set with open permissions: ugo+rw
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:22 devstack sudo[105226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e
Jul 06 13:39:22 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:22 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.071s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Deleted volume successfully.
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1a9725cd-e993-464d-a4da-1e0d8fd8c8f5 tempest-SnapshotDependencyTests-471438683 None] Lock "cinder-0ff3a27e-7509-40f0-b32d-c342f7b63b49-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:22 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537" returned: 0 in 1.098s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:22 devstack sudo[105232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537
Jul 06 13:39:22 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:23 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" returned: 0 in 0.933s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:23 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info
Jul 06 13:39:23 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:23 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-760087d2-a5cb-4d55-be95-214210bad537" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-760087d2-a5cb-4d55-be95-214210bad537" released by "delete_volume" :: held 1.938s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Created reservations ['690a3406-fed7-4750-96c7-cd9108df0619', '82fdaaf2-4966-4263-b758-83ef174d9105', 'f00d7586-5e46-4d32-abea-ba4f180d1bf9', 'eb358596-301c-4582-bf1c-fe75111273a5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:23 devstack sudo[105240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:23 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-a28bc123-d021-426e-9edc-2907a142cb3d-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-a28bc123-d021-426e-9edc-2907a142cb3d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "cinder-quobyte-a28bc123-d021-426e-9edc-2907a142cb3d" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:24 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info" returned: 0 in 0.789s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:24 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info is being set with open permissions: ugo+rw
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-a28bc123-d021-426e-9edc-2907a142cb3d" acquired by "delete_volume" :: waited 0.048s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:24 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info
Jul 06 13:39:24 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d369b-9930-45fc-8e7d-e15ad2098ef1]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:24 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d
Jul 06 13:39:24 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:24 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.995s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Deleted volume successfully.
Jul 06 13:39:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c6a52b50-5c1c-4b45-8035-a6794114c037 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-760087d2-a5cb-4d55-be95-214210bad537-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:25 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d" returned: 0 in 0.977s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:25 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.info" returned: 0 in 1.060s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:25 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d
Jul 06 13:39:25 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.891s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:25 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1d1cc31c-dc0d-4ed5-b79c-134666ada037 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Create snapshot completed successfully
Jul 06 13:39:26 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a28bc123-d021-426e-9edc-2907a142cb3d" returned: 0 in 0.938s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-quobyte-a28bc123-d021-426e-9edc-2907a142cb3d" released by "delete_volume" :: held 1.978s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Created reservations ['5778b4d4-7384-4aaa-9b0d-fb9203ccfc23', '858b928c-fef9-4cb1-9241-f2d7c0da0cd1', 'e4caf100-d38a-4ddc-bf4a-5657969d658e', '13447b6d-ac35-45c5-bafc-81a1c2ca0073'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:26 devstack sudo[105256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:26 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (ca538ae5-445c-488b-a5d7-9d87e5373dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93388e2a-f6cc-4fbd-8464-1bca3d9809a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93388e2a-f6cc-4fbd-8464-1bca3d9809a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661656691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e3c91b-a016-478f-aba7-dc472f2a696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:26Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1befc4-867b-4d13-a862-eeb614fb8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb1befc4-867b-4d13-a862-eeb614fb8e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fbe5a9-367f-4b7e-b6fe-d0e39e90fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56fbe5a9-367f-4b7e-b6fe-d0e39e90fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e3c91b-a016-478f-aba7-dc472f2a696a', 'volume_name': 'volume-51e3c91b-a016-478f-aba7-dc472f2a696a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6c66c8-81ea-46a4-adf7-3d0018383736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6c66c8-81ea-46a4-adf7-3d0018383736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0a41a8-718b-4662-b373-939f3beb4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume 51e3c91b-a016-478f-aba7-dc472f2a696a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e3c91b-a016-478f-aba7-dc472f2a696a', 'volume_size': 1}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661656691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e3c91b-a016-478f-aba7-dc472f2a696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:26Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume 51e3c91b-a016-478f-aba7-dc472f2a696a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:26 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:26 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a 1073741824
Jul 06 13:39:26 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (28fea85b-ab62-4c44-beed-5abb06775b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafc5e35-529c-48eb-83d7-225dc13ec847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafc5e35-529c-48eb-83d7-225dc13ec847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546135945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c9831-4432-4641-a3f1-52d2fbb168b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:27Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bf1769-74f7-46f0-b057-522d4baa8f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36bf1769-74f7-46f0-b057-522d4baa8f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d632e175-c61e-4a3a-90f9-8c694aed97aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d632e175-c61e-4a3a-90f9-8c694aed97aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50c9831-4432-4641-a3f1-52d2fbb168b0', 'volume_name': 'volume-b50c9831-4432-4641-a3f1-52d2fbb168b0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef033e-4027-45d7-9b91-cafe70dd5664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fef033e-4027-45d7-9b91-cafe70dd5664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfadcf0b-0e99-4626-ad04-07ce42c49e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume b50c9831-4432-4641-a3f1-52d2fbb168b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50c9831-4432-4641-a3f1-52d2fbb168b0', 'volume_size': 1}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (616636f2-d9b4-4fd0-b41d-f474e377236d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3000e908-d04e-4b36-8167-d27aadb61e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3000e908-d04e-4b36-8167-d27aadb61e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988293208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6bebe2-49a0-49c4-be7c-4b611d79c8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:28Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1a5d77-4b42-4624-ad6e-db0f73e1a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1a5d77-4b42-4624-ad6e-db0f73e1a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d154efa-ee8c-45f0-b26a-7b498be96ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d154efa-ee8c-45f0-b26a-7b498be96ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6bebe2-49a0-49c4-be7c-4b611d79c8b5', 'volume_name': 'volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e842433f-39aa-482f-b356-e79183991643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e842433f-39aa-482f-b356-e79183991643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b828a42-15bb-420a-80f8-0b05e47d78ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:27 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume ec6bebe2-49a0-49c4-be7c-4b611d79c8b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5', 'volume_size': 1}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:27 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 1.542s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:27 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Deleted volume successfully.
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-43de829f-fc91-46c9-b81a-cc99225bd984 tempest-CinderUnicodeTest-389954049 None] Lock "cinder-a28bc123-d021-426e-9edc-2907a142cb3d-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (8f00b547-f824-40ce-9a9b-e62b35fc8ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b0fd9b-26f3-4b08-a736-46620bfd572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:28 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b0fd9b-26f3-4b08-a736-46620bfd572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681719073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196064ed-96c9-43ce-a319-721dd5119397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:28Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d9856-2ed9-42e6-8507-a06bf861c38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d9856-2ed9-42e6-8507-a06bf861c38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fdbe42-2275-4d71-a83d-a0302e10d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fdbe42-2275-4d71-a83d-a0302e10d792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196064ed-96c9-43ce-a319-721dd5119397', 'volume_name': 'volume-196064ed-96c9-43ce-a319-721dd5119397', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e72e0e-3f2d-4815-86dd-3d02df0cd671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e72e0e-3f2d-4815-86dd-3d02df0cd671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79adc8b-ce1e-4cc9-84ea-7592d49ade24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:28 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume 196064ed-96c9-43ce-a319-721dd5119397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196064ed-96c9-43ce-a319-721dd5119397', 'volume_size': 1}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a 1073741824" returned: 0 in 1.950s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:28 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a
Jul 06 13:39:28 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (1afcbd72-7bf3-4aa8-9205-6cfbfe667ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc14463-6d80-4d3b-92d3-915c65f698b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc14463-6d80-4d3b-92d3-915c65f698b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144008538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a0b378-3d69-458c-8c12-ff8f0bb9bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:29Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4611421-aa29-4bc3-bafb-2aeae50ba8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4611421-aa29-4bc3-bafb-2aeae50ba8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68863ec-9795-460f-901f-8ad3d021caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a68863ec-9795-460f-901f-8ad3d021caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a0b378-3d69-458c-8c12-ff8f0bb9bbf3', 'volume_name': 'volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fda026-bbea-482b-a439-a0f3a877990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6fda026-bbea-482b-a439-a0f3a877990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458f80a0-2238-4d45-af7f-282d64390984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume 17a0b378-3d69-458c-8c12-ff8f0bb9bbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3', 'volume_size': 1}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:29 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a" returned: 0 in 1.011s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (3025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.029s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546135945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50c9831-4432-4641-a3f1-52d2fbb168b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:27Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume b50c9831-4432-4641-a3f1-52d2fbb168b0 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:29 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0a41a8-718b-4662-b373-939f3beb4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e3c91b-a016-478f-aba7-dc472f2a696a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack sudo[105270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 1073741824
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effd729e-e30f-4c71-9435-a5918faf5838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:29 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:29 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-51e3c91b-a016-478f-aba7-dc472f2a696a (51e3c91b-a016-478f-aba7-dc472f2a696a): created successfully
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effd729e-e30f-4c71-9435-a5918faf5838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:29 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (ca538ae5-445c-488b-a5d7-9d87e5373dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:29 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2beb6352-2411-472a-9d87-46cb9702d761 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:30 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 1073741824" returned: 0 in 1.153s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:31 devstack sudo[105279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0
Jul 06 13:39:31 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:31 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0" returned: 0 in 0.956s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.031s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988293208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6bebe2-49a0-49c4-be7c-4b611d79c8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:28Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:31 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:31 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 1073741824
Jul 06 13:39:31 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfadcf0b-0e99-4626-ad04-07ce42c49e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50c9831-4432-4641-a3f1-52d2fbb168b0', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:31 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579d34c1-9524-484b-b19e-71a343da2e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 (b50c9831-4432-4641-a3f1-52d2fbb168b0): created successfully
Jul 06 13:39:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579d34c1-9524-484b-b19e-71a343da2e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (28fea85b-ab62-4c44-beed-5abb06775b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a5677002-07ce-4ec6-b7db-725575ffc817 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:33 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 1073741824" returned: 0 in 1.175s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:33 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5
Jul 06 13:39:33 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:33 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" returned: 0 in 0.756s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.251s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681719073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196064ed-96c9-43ce-a319-721dd5119397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:28Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume 196064ed-96c9-43ce-a319-721dd5119397 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:33 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b828a42-15bb-420a-80f8-0b05e47d78ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:33 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 1073741824
Jul 06 13:39:33 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884e00cc-04c4-4cc1-9d61-8a0c111c8f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:33 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:34 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 (ec6bebe2-49a0-49c4-be7c-4b611d79c8b5): created successfully
Jul 06 13:39:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (884e00cc-04c4-4cc1-9d61-8a0c111c8f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (616636f2-d9b4-4fd0-b41d-f474e377236d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9d374797-ae66-41ed-a596-7a6793f4a87e tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:35 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 1073741824" returned: 0 in 1.176s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:35 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397
Jul 06 13:39:35 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:35 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397" returned: 0 in 0.710s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.503s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-144008538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a0b378-3d69-458c-8c12-ff8f0bb9bbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763f4cd928d74f7fb709ebc45ffcffff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:29Z,use_quota=True,user_id='70ff472ecfd84afbae0c5f6506cb5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Creating volume 17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:35 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79adc8b-ce1e-4cc9-84ea-7592d49ade24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196064ed-96c9-43ce-a319-721dd5119397', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:35 devstack sudo[105303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 1073741824
Jul 06 13:39:35 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86edc76-4a6a-43ba-8711-b3f8d83d96dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:35 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-196064ed-96c9-43ce-a319-721dd5119397 (196064ed-96c9-43ce-a319-721dd5119397): created successfully
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86edc76-4a6a-43ba-8711-b3f8d83d96dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (8f00b547-f824-40ce-9a9b-e62b35fc8ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-65b63be6-4b48-4b2a-ada5-92671496d228 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:36 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 1073741824" returned: 0 in 0.871s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:36 devstack sudo[105309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3
Jul 06 13:39:36 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:37 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" returned: 0 in 0.704s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458f80a0-2238-4d45-af7f-282d64390984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42828c7d-ba0e-482a-a81b-ed799776a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:37 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Volume volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 (17a0b378-3d69-458c-8c12-ff8f0bb9bbf3): created successfully
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42828c7d-ba0e-482a-a81b-ed799776a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:37 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Flow 'volume_create_manager' (1afcbd72-7bf3-4aa8-9205-6cfbfe667ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d67ee1e5-abad-4582-833a-c38ae1926c1a tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created volume successfully.
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cdc563-58f1-4aa7-8c27-de9acc78fe56]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:38 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3
Jul 06 13:39:38 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:39 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" returned: 0 in 0.815s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:39 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3
Jul 06 13:39:39 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:39 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" returned: 0 in 0.699s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3" released by "delete_volume" :: held 1.567s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['5bc52961-3e73-4004-a22d-d8faf1dbeb60', '83ef42ad-4f79-4b2e-b979-4ea16923071f', '9db5d9e7-b29c-4f06-b393-b91644c282b0', 'b7ebfaef-31db-4561-b51b-c42713fb09d3'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:40 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:40 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-196064ed-96c9-43ce-a319-721dd5119397-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-196064ed-96c9-43ce-a319-721dd5119397-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-196064ed-96c9-43ce-a319-721dd5119397" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-196064ed-96c9-43ce-a319-721dd5119397" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a9f0b0-1f0d-42d2-badb-c26d44a30fa0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:40 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.688s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:40 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:40 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-37a1a035-0602-48dc-a68b-97eaf17d4070 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-17a0b378-3d69-458c-8c12-ff8f0bb9bbf3-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:40 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397
Jul 06 13:39:40 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:41 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:41 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397
Jul 06 13:39:41 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (8c845fd0-d514-4e80-ac0f-dafff5bc3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b696d1d7-b5ec-419a-b082-d237e8f86288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b696d1d7-b5ec-419a-b082-d237e8f86288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350307135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a410ca4b-7f18-44e3-84a3-015aa3a9e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:41Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3bfa3d-3782-4234-9c6f-c89d7893ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3bfa3d-3782-4234-9c6f-c89d7893ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf35f3e1-9c96-473b-9c64-dc6883552769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf35f3e1-9c96-473b-9c64-dc6883552769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a410ca4b-7f18-44e3-84a3-015aa3a9e6b4', 'volume_name': 'volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bfd4ba-fa8f-41e5-a0a4-a2a88ede9f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83bfd4ba-fa8f-41e5-a0a4-a2a88ede9f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8411a561-82b1-4a12-b645-59e7028bc5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Volume a410ca4b-7f18-44e3-84a3-015aa3a9e6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4', 'volume_size': 1}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1350307135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a410ca4b-7f18-44e3-84a3-015aa3a9e6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:41Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Creating volume a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:41 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:41 devstack sudo[105331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 1073741824
Jul 06 13:39:41 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Flow 'volume_create_manager' (b70cb6a4-0a38-40a0-b80d-072d9e8c73f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6df4669-9542-43a8-8ccf-4c3fefc8dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6df4669-9542-43a8-8ccf-4c3fefc8dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-312975288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b6fc6f-5faa-430a-8f84-e5baf09481b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1559b9d6a83149049bab72b42d8fdc7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:42Z,use_quota=True,user_id='bfa403b1bac040f799d6b13240d62cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244e39d9-2aac-428b-902d-9d626d8fb8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244e39d9-2aac-428b-902d-9d626d8fb8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a71d42-8e47-4758-afbc-bf17699a85dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a71d42-8e47-4758-afbc-bf17699a85dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b6fc6f-5faa-430a-8f84-e5baf09481b7', 'volume_name': 'volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26daa0ec-3375-40f2-b460-569b5b6b8fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26daa0ec-3375-40f2-b460-569b5b6b8fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f16159-2b75-48e9-98a4-ff605ab13e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:41 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Volume 48b6fc6f-5faa-430a-8f84-e5baf09481b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7', 'volume_size': 1}
Jul 06 13:39:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:42 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-196064ed-96c9-43ce-a319-721dd5119397" returned: 0 in 0.657s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-196064ed-96c9-43ce-a319-721dd5119397" released by "delete_volume" :: held 1.567s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['c378198f-a93e-40a8-8efd-596f7f6fa7f6', '03775da0-549c-41be-849c-644630f76f2c', '449571c2-496d-4b32-a55f-efa10555d84f', 'ffe72d7b-45b2-496d-8470-46d36ae9de50'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:42 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:42 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:42 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 1073741824" returned: 0 in 0.877s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:42 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4
Jul 06 13:39:42 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" acquired by "delete_volume" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[41045e85-d44b-4251-9717-85976efd31a2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:42 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.689s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:42 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:42 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5
Jul 06 13:39:42 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6897672a-f5a0-430d-b448-d2d6acf2ea0f tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-196064ed-96c9-43ce-a319-721dd5119397-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:43 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" returned: 0 in 0.657s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.462s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-312975288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b6fc6f-5faa-430a-8f84-e5baf09481b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1559b9d6a83149049bab72b42d8fdc7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:42Z,use_quota=True,user_id='bfa403b1bac040f799d6b13240d62cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Creating volume 48b6fc6f-5faa-430a-8f84-e5baf09481b7 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:43 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8411a561-82b1-4a12-b645-59e7028bc5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde60a32-6d49-4d4b-b76f-a2f063221565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:43 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 1073741824
Jul 06 13:39:43 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:43 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Volume volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 (a410ca4b-7f18-44e3-84a3-015aa3a9e6b4): created successfully
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fde60a32-6d49-4d4b-b76f-a2f063221565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (8c845fd0-d514-4e80-ac0f-dafff5bc3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:43 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b2de7e1e-373a-433b-861b-7c6f4ff0c373 tempest-ProjectReaderTests-890679722 None] Created volume successfully.
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:43 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "cinder-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:43 devstack sudo[105352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5
Jul 06 13:39:43 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-quobyte-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568546e-9043-4253-9379-d83a90d96c03]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:43 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4
Jul 06 13:39:43 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:44 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 1073741824" returned: 0 in 0.911s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:44 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7
Jul 06 13:39:44 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:44 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" returned: 0 in 0.710s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5" released by "delete_volume" :: held 1.581s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['541eb85c-dd99-4817-bba0-ef1f975c19ca', '0776d149-d5be-45b9-974f-8ee50738edbb', 'd0109b06-bd0b-404d-89af-3f49152ea6fd', '71562ac8-7b21-4fac-ba63-98ea7cb0420d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:44 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:44 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:44 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" returned: 0 in 0.871s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:44 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4
Jul 06 13:39:44 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:44 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7" returned: 0 in 0.686s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f16159-2b75-48e9-98a4-ff605ab13e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674395ca-79a7-4609-ac30-80e73b5ed314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:44 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Volume volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 (48b6fc6f-5faa-430a-8f84-e5baf09481b7): created successfully
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674395ca-79a7-4609-ac30-80e73b5ed314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Flow 'volume_create_manager' (b70cb6a4-0a38-40a0-b80d-072d9e8c73f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-de6eb3a0-99c9-4ba1-99e7-eefd5105f947 tempest-ProjectReaderTests-822683094 None] Created volume successfully.
Jul 06 13:39:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-b50c9831-4432-4641-a3f1-52d2fbb168b0-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-b50c9831-4432-4641-a3f1-52d2fbb168b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-b50c9831-4432-4641-a3f1-52d2fbb168b0" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-b50c9831-4432-4641-a3f1-52d2fbb168b0" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cabbfae-7498-488f-bc27-aa29a8fffaad]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:45 devstack sudo[105370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0
Jul 06 13:39:45 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:45 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.706s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:45 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-2781f12e-9a3f-467b-b1e6-a41f5c0a3c90 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-ec6bebe2-49a0-49c4-be7c-4b611d79c8b5-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:45 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4" released by "delete_volume" :: held 1.646s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Created reservations ['ae26dd55-7e50-428d-aa19-068d96cff28b', 'cbc4b67d-264a-4ad5-8158-799404ae9c20', 'f2c53cb4-a69c-4677-beb1-50817ffc48c3', '9de2fd4f-64a2-4177-ad91-11d78cedb4de'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:45 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:45 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Acquiring lock "cinder-48b6fc6f-5faa-430a-8f84-e5baf09481b7-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "cinder-48b6fc6f-5faa-430a-8f84-e5baf09481b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Acquiring lock "cinder-quobyte-48b6fc6f-5faa-430a-8f84-e5baf09481b7" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "cinder-quobyte-48b6fc6f-5faa-430a-8f84-e5baf09481b7" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[452e7246-aa37-4e51-9321-ea7446ec8945]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:46 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0" returned: 0 in 1.006s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:46 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0
Jul 06 13:39:46 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:46 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7
Jul 06 13:39:46 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:46 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.800s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Deleted volume successfully.
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-756910ee-1274-42a4-94f5-2484a1147390 tempest-ProjectReaderTests-890679722 None] Lock "cinder-a410ca4b-7f18-44e3-84a3-015aa3a9e6b4-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=125,cinder:INSERT=44,cinder:UPDATE=180,cinder:DELETE=16 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (b74a28b1-2c27-415a-a638-16116c7f157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663caf05-4795-4125-99a0-55a114196f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663caf05-4795-4125-99a0-55a114196f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1500916084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d378f0e-871e-45d5-9cfd-017306a626c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:47Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b331e1c-45c5-4fca-be7a-9b134d5545b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b331e1c-45c5-4fca-be7a-9b134d5545b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a503ca-a583-4cee-95c0-287c7535f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a503ca-a583-4cee-95c0-287c7535f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d378f0e-871e-45d5-9cfd-017306a626c2', 'volume_name': 'volume-9d378f0e-871e-45d5-9cfd-017306a626c2', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c59d23-bd0f-4583-8cdc-9528f15a7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c59d23-bd0f-4583-8cdc-9528f15a7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5bd5e0-fc8d-42a3-8620-d4ada46001f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Volume 9d378f0e-871e-45d5-9cfd-017306a626c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d378f0e-871e-45d5-9cfd-017306a626c2', 'volume_size': 1}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1500916084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d378f0e-871e-45d5-9cfd-017306a626c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:47Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Creating volume 9d378f0e-871e-45d5-9cfd-017306a626c2 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:46 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:46 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 1073741824
Jul 06 13:39:46 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:46 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-b50c9831-4432-4641-a3f1-52d2fbb168b0" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-b50c9831-4432-4641-a3f1-52d2fbb168b0" released by "delete_volume" :: held 1.859s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:47 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['6c91a6e6-9f2d-4698-81a3-5cc8dbf03554', '14e59357-a5c8-48bf-a7a4-a672d222429b', 'f2ae1c25-4b47-4f2c-bb11-60e2d70f7056', '49ad22fd-1bbd-42fc-b303-8d58c6ef11c5'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7" returned: 0 in 0.916s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:47 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7
Jul 06 13:39:47 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:47 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:47 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-51e3c91b-a016-478f-aba7-dc472f2a696a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-51e3c91b-a016-478f-aba7-dc472f2a696a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=172,cinder:DELETE=16,cinder:INSERT=48,cinder:SELECT=129 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-51e3c91b-a016-478f-aba7-dc472f2a696a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-51e3c91b-a016-478f-aba7-dc472f2a696a" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f426ae-0dcb-461f-9e4c-e3748acf379d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:47 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a
Jul 06 13:39:47 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:47 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 1073741824" returned: 0 in 1.026s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:47 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-48b6fc6f-5faa-430a-8f84-e5baf09481b7" returned: 0 in 0.792s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:47 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2
Jul 06 13:39:47 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "cinder-quobyte-48b6fc6f-5faa-430a-8f84-e5baf09481b7" released by "delete_volume" :: held 1.772s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Created reservations ['7a31e3ee-ab52-44cf-872b-451865b19ffb', '76eb828a-414d-4d83-9bcc-7bc62a9de32f', '9469f502-8966-4b03-89e8-6bbde3637643', '5153e2bf-5de2-4eea-96cc-828af435fbc8'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:47 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:47 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:47 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:47 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:47 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4adc549f-94b6-4381-91f0-1c9df3e2269b tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-b50c9831-4432-4641-a3f1-52d2fbb168b0-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:48 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a" returned: 0 in 0.958s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:48 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a
Jul 06 13:39:48 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:48 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2" returned: 0 in 0.855s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5bd5e0-fc8d-42a3-8620-d4ada46001f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d378f0e-871e-45d5-9cfd-017306a626c2', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4d1f4-cb3a-4950-b32f-11c1a51f5672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Volume volume-9d378f0e-871e-45d5-9cfd-017306a626c2 (9d378f0e-871e-45d5-9cfd-017306a626c2): created successfully
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a4d1f4-cb3a-4950-b32f-11c1a51f5672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (b74a28b1-2c27-415a-a638-16116c7f157f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:48 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c752663e-fb5d-4b95-bf4f-bcfc6b5d1aba tempest-ProjectReaderTests-890679722 None] Created volume successfully.
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.787s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Deleted volume successfully.
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6808c489-dc8c-435e-8837-d94c91fa4238 tempest-ProjectReaderTests-822683094 None] Lock "cinder-48b6fc6f-5faa-430a-8f84-e5baf09481b7-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Flow 'volume_create_manager' (00d0af7d-2e26-47b7-985b-3ef10d8afbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d103fb-65b6-4ec5-8921-822c9ebe9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d103fb-65b6-4ec5-8921-822c9ebe9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566207790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fcb87b-3c2c-44ec-a086-8f282646d48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1559b9d6a83149049bab72b42d8fdc7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:49Z,use_quota=True,user_id='bfa403b1bac040f799d6b13240d62cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf82f2e4-0f99-4f8e-af21-fa26e30ebf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf82f2e4-0f99-4f8e-af21-fa26e30ebf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87460ab-f770-4c3a-9f0f-89f1b8231fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87460ab-f770-4c3a-9f0f-89f1b8231fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0fcb87b-3c2c-44ec-a086-8f282646d48f', 'volume_name': 'volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52befa2-344d-45d7-bbe4-747a50edeff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52befa2-344d-45d7-bbe4-747a50edeff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b32da34-8470-488a-8f86-5e7a9f6578b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Volume a0fcb87b-3c2c-44ec-a086-8f282646d48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f', 'volume_size': 1}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566207790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0fcb87b-3c2c-44ec-a086-8f282646d48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1559b9d6a83149049bab72b42d8fdc7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:49Z,use_quota=True,user_id='bfa403b1bac040f799d6b13240d62cc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Creating volume a0fcb87b-3c2c-44ec-a086-8f282646d48f {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:48 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:48 devstack sudo[105414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f 1073741824
Jul 06 13:39:48 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:49 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-51e3c91b-a016-478f-aba7-dc472f2a696a" returned: 0 in 0.817s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-51e3c91b-a016-478f-aba7-dc472f2a696a" released by "delete_volume" :: held 1.816s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['2d7d5f25-a11a-413d-90fe-67374d87f30b', '2fd77a9b-1668-4361-bbf6-d58cebe24216', '196929c0-ee9f-42aa-a7b1-45c673c9bd32', '1ef3fca5-d35d-4f89-88de-ebe88fca723d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:49 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:49 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleting offline snapshot cf1fb13f-acc7-48ed-a75c-b0217c9bc81e of volume 89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] snapshot_file for this snap is: volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[6379d7af-674d-4419-bca4-25f7945e88ec]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:49 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e
Jul 06 13:39:49 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-9d378f0e-871e-45d5-9cfd-017306a626c2-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "cinder-9d378f0e-871e-45d5-9cfd-017306a626c2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-quobyte-9d378f0e-871e-45d5-9cfd-017306a626c2" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:50 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f 1073741824" returned: 0 in 1.095s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-9d378f0e-871e-45d5-9cfd-017306a626c2" acquired by "delete_volume" :: waited 0.028s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:50 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e64d89-d62f-4d6d-bd78-75acdf7b6cda]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.751s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-32c38975-b030-44f0-9ec5-2afde449d304 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-51e3c91b-a016-478f-aba7-dc472f2a696a-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:50 devstack sudo[105427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f
Jul 06 13:39:50 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:50 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2
Jul 06 13:39:50 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:50 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" returned: 0 in 0.880s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5ef391-8b8a-4238-8314-5240145ce24b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:50 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a
Jul 06 13:39:50 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:50 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f" returned: 0 in 0.712s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b32da34-8470-488a-8f86-5e7a9f6578b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed71de-113e-4f5c-83e0-7d4515125d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:50 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Volume volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f (a0fcb87b-3c2c-44ec-a086-8f282646d48f): created successfully
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ed71de-113e-4f5c-83e0-7d4515125d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Flow 'volume_create_manager' (00d0af7d-2e26-47b7-985b-3ef10d8afbab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:50 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f71a5959-59a6-4c69-90ab-d7b13b18e52d tempest-ProjectReaderTests-822683094 None] Created volume successfully.
Jul 06 13:39:50 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2" returned: 0 in 0.850s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:50 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2
Jul 06 13:39:50 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:51 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" returned: 0 in 0.868s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:51 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e
Jul 06 13:39:51 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:51 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-9d378f0e-871e-45d5-9cfd-017306a626c2" returned: 0 in 0.641s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-9d378f0e-871e-45d5-9cfd-017306a626c2" released by "delete_volume" :: held 1.552s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Created reservations ['6bd269f3-6244-4d6a-98a8-fc0cb4453390', '2525a105-1d3e-48be-8034-01372760c457', 'a39d5d74-03dd-43ae-9d43-0b63f147e646', '3e860143-99c0-47a6-9ee0-2cc9fe329d3d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:51 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:51 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Acquiring lock "cinder-a0fcb87b-3c2c-44ec-a086-8f282646d48f-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "cinder-a0fcb87b-3c2c-44ec-a086-8f282646d48f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Acquiring lock "cinder-quobyte-a0fcb87b-3c2c-44ec-a086-8f282646d48f" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "cinder-quobyte-a0fcb87b-3c2c-44ec-a086-8f282646d48f" acquired by "delete_volume" :: waited 0.029s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25ab9b-a9e1-42a9-b5aa-942512112ff8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:52 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" returned: 0 in 0.884s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:52 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e
Jul 06 13:39:52 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:52 devstack sudo[105452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f
Jul 06 13:39:52 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:52 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.751s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:52 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Deleted volume successfully.
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-c429ef88-611a-4755-a1b4-72a241d660fd tempest-ProjectReaderTests-890679722 None] Lock "cinder-9d378f0e-871e-45d5-9cfd-017306a626c2-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (b4fbfda3-bea5-457f-8a39-6cff64d9fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4c6504-957f-42ce-a8db-2160f3501fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4c6504-957f-42ce-a8db-2160f3501fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470738293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7241e4-608d-4f83-804a-16ced35596fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:53Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dc8db0-b46a-433d-b095-9ecebc83c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8dc8db0-b46a-433d-b095-9ecebc83c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b99ed-9975-42a9-9045-25712af157df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b99ed-9975-42a9-9045-25712af157df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7241e4-608d-4f83-804a-16ced35596fc', 'volume_name': 'volume-5d7241e4-608d-4f83-804a-16ced35596fc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5108bd6c-71f5-4b08-bc2c-07dc3786ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5108bd6c-71f5-4b08-bc2c-07dc3786ce12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23596202-32d0-43a7-9053-48e9d0df2ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:52 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Volume 5d7241e4-608d-4f83-804a-16ced35596fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7241e4-608d-4f83-804a-16ced35596fc', 'volume_size': 1}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470738293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7241e4-608d-4f83-804a-16ced35596fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:53Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Creating volume 5d7241e4-608d-4f83-804a-16ced35596fc {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:52 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:52 devstack sudo[105457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc 1073741824
Jul 06 13:39:52 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:53 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a.cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" returned: 0 in 0.754s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e" released by "_delete_snapshot" :: held 3.505s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" released by "delete_snapshot" :: held 3.528s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['d4ce5caa-1610-4237-ab65-39836d6737fb', '387edad2-41c0-46c8-8d3c-e7418082b3ca', '804cdebf-f77c-4188-8546-162b28cf49a3', '9d670f16-bc56-4362-a3a7-7be0523ac2d6'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Delete snapshot completed successfully.
Jul 06 13:39:53 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f" returned: 0 in 1.103s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3be52fd2-c330-4539-b616-0b333ec31f65 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-cf1fb13f-acc7-48ed-a75c-b0217c9bc81e-delete_snapshot" released by "delete_snapshot" :: held 3.745s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:53 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f
Jul 06 13:39:53 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:53 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc 1073741824" returned: 0 in 0.911s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:53 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc
Jul 06 13:39:53 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:53 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7b04ae-dcab-4611-ae61-8cb01034824b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:54 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-a0fcb87b-3c2c-44ec-a086-8f282646d48f" returned: 0 in 0.702s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "cinder-quobyte-a0fcb87b-3c2c-44ec-a086-8f282646d48f" released by "delete_volume" :: held 1.856s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Created reservations ['1875c99c-98bc-4a68-aad9-0482a98c01e8', '08b95b89-e7ea-4ce6-b274-65b0a0026417', 'c2792465-7524-4630-a377-ecc7fab16459', 'd597ee53-8299-4eba-96c2-7524c0a97d64'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:54 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a
Jul 06 13:39:54 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:54 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:54 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:54 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc" returned: 0 in 0.737s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23596202-32d0-43a7-9053-48e9d0df2ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7241e4-608d-4f83-804a-16ced35596fc', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e828ddb1-f92f-48ce-b592-73035814ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:54 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Volume volume-5d7241e4-608d-4f83-804a-16ced35596fc (5d7241e4-608d-4f83-804a-16ced35596fc): created successfully
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e828ddb1-f92f-48ce-b592-73035814ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (b4fbfda3-bea5-457f-8a39-6cff64d9fbec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:54 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ce16a80c-fe0d-48dd-9adf-07283618b3a3 tempest-ProjectReaderTests-890679722 None] Created volume successfully.
Jul 06 13:39:54 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:54 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a
Jul 06 13:39:54 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-5d7241e4-608d-4f83-804a-16ced35596fc-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:54 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.824s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:54 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "cinder-5d7241e4-608d-4f83-804a-16ced35596fc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Deleted volume successfully.
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-061423a0-80b8-4a26-a24d-0a2e870f16f9 tempest-ProjectReaderTests-822683094 None] Lock "cinder-a0fcb87b-3c2c-44ec-a086-8f282646d48f-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-quobyte-5d7241e4-608d-4f83-804a-16ced35596fc" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-5d7241e4-608d-4f83-804a-16ced35596fc" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea948707-c40d-4aef-87fe-59abde9c7526]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:55 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc
Jul 06 13:39:55 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:55 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" returned: 0 in 0.774s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-quobyte-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a" released by "delete_volume" :: held 1.645s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Created reservations ['42d2a24b-25b0-4f72-9240-83f5ee10f044', 'f383ca65-2d7d-439c-bbc5-15a7f9481abc', '255049ec-6b1b-4744-8b2b-ef7d325b3581', '1a3b974d-6cc5-4a87-b66c-8d371fc6a127'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:55 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:55 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:56 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc" returned: 0 in 0.900s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:56 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc
Jul 06 13:39:56 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:56 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.786s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:56 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Deleted volume successfully.
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-100b7556-6a4a-4a1c-a277-c3b0078d8b64 tempest-CreateVolumesFromSnapshotTest-1829070142 None] Lock "cinder-89b41ea1-ef3e-4a63-bbc4-a6d5a006a15a-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:56 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-5d7241e4-608d-4f83-804a-16ced35596fc" returned: 0 in 0.783s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-5d7241e4-608d-4f83-804a-16ced35596fc" released by "delete_volume" :: held 1.737s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Created reservations ['4a3c97e3-9be4-4301-a118-08673703d2cf', 'dedbcdbf-05ff-46e8-8400-d43202432b7e', 'ac9d01e6-0e05-4f2b-b81b-9aec6aacc3d0', '0045b8cc-d791-4794-b2ce-d574457cba0c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:57 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:39:57 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:57 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.845s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:39:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Deleted volume successfully.
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-44aad38f-570c-4d46-8fc4-09641aace72c tempest-ProjectReaderTests-890679722 None] Lock "cinder-5d7241e4-608d-4f83-804a-16ced35596fc-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (3a2a7614-3ac6-4065-9ff7-075835f5ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4df3519-193d-4107-be28-7a62f63c0f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4df3519-193d-4107-be28-7a62f63c0f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1431929648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dbe8e7-1aee-4815-a54b-996e097f4904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:58Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:57 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c00d63-5008-4e72-bcb8-d0aee4fb6c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c00d63-5008-4e72-bcb8-d0aee4fb6c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280b180b-2e34-41ef-ad6d-d561f3812d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280b180b-2e34-41ef-ad6d-d561f3812d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87dbe8e7-1aee-4815-a54b-996e097f4904', 'volume_name': 'volume-87dbe8e7-1aee-4815-a54b-996e097f4904', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2983449-d191-42f5-b172-24912587bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2983449-d191-42f5-b172-24912587bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54644a1-5a24-43f5-b93b-dee3e3b57abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Volume 87dbe8e7-1aee-4815-a54b-996e097f4904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87dbe8e7-1aee-4815-a54b-996e097f4904', 'volume_size': 1}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1431929648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87dbe8e7-1aee-4815-a54b-996e097f4904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edad49ee42c84e1fa67157200e1af639',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:39:58Z,use_quota=True,user_id='bfb629639d6e47479761fb446092f704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Creating volume 87dbe8e7-1aee-4815-a54b-996e097f4904 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:39:58 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:39:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:58 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 1073741824
Jul 06 13:39:58 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:59 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 1073741824" returned: 0 in 1.014s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:39:59 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904
Jul 06 13:39:59 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:39:59 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904" returned: 0 in 0.745s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54644a1-5a24-43f5-b93b-dee3e3b57abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87dbe8e7-1aee-4815-a54b-996e097f4904', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae1d611-a760-42a9-8e4d-28d09be79599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:39:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Volume volume-87dbe8e7-1aee-4815-a54b-996e097f4904 (87dbe8e7-1aee-4815-a54b-996e097f4904): created successfully
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae1d611-a760-42a9-8e4d-28d09be79599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:39:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Flow 'volume_create_manager' (3a2a7614-3ac6-4065-9ff7-075835f5ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:39:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c0e7db35-9cbb-440b-93d7-f751b1d69914 tempest-ProjectReaderTests-890679722 None] Created volume successfully.
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-87dbe8e7-1aee-4815-a54b-996e097f4904-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "cinder-87dbe8e7-1aee-4815-a54b-996e097f4904-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Acquiring lock "cinder-quobyte-87dbe8e7-1aee-4815-a54b-996e097f4904" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-87dbe8e7-1aee-4815-a54b-996e097f4904" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ab18a-d776-4d6e-a8b1-5e467cd3b61c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:01 devstack sudo[105511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904
Jul 06 13:40:01 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:01 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904" returned: 0 in 0.818s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:02 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904
Jul 06 13:40:02 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:02 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-87dbe8e7-1aee-4815-a54b-996e097f4904" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "cinder-quobyte-87dbe8e7-1aee-4815-a54b-996e097f4904" released by "delete_volume" :: held 1.512s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Created reservations ['1377ad17-244d-4ccd-8fdb-0f61ae255792', '266046d8-c6ab-43a1-aefe-849f4d50b0d0', 'b51c57cf-273e-4035-bc64-2124d1263baf', 'cdb58144-c3c2-4135-a868-b9cc09a53640'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:02 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:02 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:03 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:03 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:03 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Deleted volume successfully.
Jul 06 13:40:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-20cb0690-ca03-4442-a252-904f75e5c1ab tempest-ProjectReaderTests-890679722 None] Lock "cinder-87dbe8e7-1aee-4815-a54b-996e097f4904-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (937242c5-daa5-4af7-b0ab-908a88de88bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0554dac-1f25-4baa-ba8d-ec7376a40731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0554dac-1f25-4baa-ba8d-ec7376a40731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799184591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:06Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d21229-ce39-4ef9-8e15-73d4df07a5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0d21229-ce39-4ef9-8e15-73d4df07a5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269c5fd1-9a35-42ff-9e13-f06c93186c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269c5fd1-9a35-42ff-9e13-f06c93186c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e', 'volume_name': 'volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4262f982-dd89-4252-aefe-d1a942d58685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4262f982-dd89-4252-aefe-d1a942d58685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f050f-4ced-4afc-82bb-549bfd5879b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:06 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Volume c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e', 'volume_size': 1}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1799184591',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:06Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Creating volume c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:40:06 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:40:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:06 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e 1073741824
Jul 06 13:40:06 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:07 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e 1073741824" returned: 0 in 0.793s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:07 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e
Jul 06 13:40:07 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:07 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" returned: 0 in 0.602s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f050f-4ced-4afc-82bb-549bfd5879b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b5913d-2dff-4eb4-96c2-65d37e2e9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:07 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Volume volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e (c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e): created successfully
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b5913d-2dff-4eb4-96c2-65d37e2e9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:07 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (937242c5-daa5-4af7-b0ab-908a88de88bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-228b7ce3-fabd-4d71-993b-26797f9b46b4 tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:40:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 of volume c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:40:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d7f94-2bf3-4423-b98b-6d685e00a319]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:08 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e
Jul 06 13:40:08 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:09 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" returned: 0 in 0.715s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:09 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 1G
Jul 06 13:40:09 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:10 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 1G" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:10 devstack sudo[105545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29
Jul 06 13:40:10 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:10 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" returned: 0 in 0.636s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:10 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 is being set with open permissions: ugo+rw
Jul 06 13:40:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:10 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29
Jul 06 13:40:10 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:11 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" returned: 0 in 0.599s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:11 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info
Jul 06 13:40:11 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:11 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info" returned: 0 in 0.642s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:11 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info is being set with open permissions: ugo+rw
Jul 06 13:40:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:11 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info
Jul 06 13:40:11 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:12 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.info" returned: 0 in 0.605s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:12 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-df7f056b-4c43-4561-b286-5b4447f5a686 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 of volume c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af9b52e-489e-4ded-ba20-6b3af8e5668d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:12 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29
Jul 06 13:40:12 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:13 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" returned: 0 in 0.737s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:40:13 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3793eaed-06c6-4ef4-ba18-8782e69f0b0e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:13 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e
Jul 06 13:40:13 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:14 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:14 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29
Jul 06 13:40:14 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:15 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:15 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29
Jul 06 13:40:15 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:15 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e.6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" returned: 0 in 0.638s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29" released by "_delete_snapshot" :: held 2.954s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" released by "delete_snapshot" :: held 2.978s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Created reservations ['cd1bb58c-6677-46b9-a439-650151e6ac8c', 'd2cfb0cd-6116-44d6-b1c5-a849d0a426a3', '40d19b85-ade9-4324-8438-5b1270b7823b', '94fb4985-346d-440c-9e1c-a06454f08600'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:15 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b736489b-9c01-4168-898f-d4e72850e8c1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-6a5588b8-2fe6-4a7e-8b2f-bab9ebf15a29-delete_snapshot" released by "delete_snapshot" :: held 3.119s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a26704-8ea3-4c3d-be1a-ce94551057a2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:16 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e
Jul 06 13:40:16 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:16 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" returned: 0 in 0.740s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:16 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e
Jul 06 13:40:16 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:17 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" returned: 0 in 0.638s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e" released by "delete_volume" :: held 1.434s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Created reservations ['f8d039a6-b97a-41c3-8a6f-e938abee1fcb', '0ceca3b4-5788-4944-b9d1-5acc2cc82dd1', '17faff9c-53bb-42ac-b59d-693b46d10c83', '057115f1-92b0-4036-be8c-81c2cabe53eb'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:17 devstack sudo[105624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:17 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:18 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.619s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-399e2634-d7a3-460c-96ef-3000fc0b2c79 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-c9a1a3a6-2786-48f2-9c1a-12bd39ebf01e-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:18 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:18 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (ab1294f6-ed0a-42d9-9837-5c13a6a8977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c7fbd1-2405-4fc9-a316-6f33de3f90fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c7fbd1-2405-4fc9-a316-6f33de3f90fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189907259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ca911e-84fe-4fea-aac1-4dddaef05142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:19Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff4d292-232d-40b2-8f9c-8c1283a045e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff4d292-232d-40b2-8f9c-8c1283a045e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bf0d2-e3d5-4717-9ccb-d0c832944a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33bf0d2-e3d5-4717-9ccb-d0c832944a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7ca911e-84fe-4fea-aac1-4dddaef05142', 'volume_name': 'volume-f7ca911e-84fe-4fea-aac1-4dddaef05142', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ccff3-f27d-43cb-8362-156ed9582deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70ccff3-f27d-43cb-8362-156ed9582deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdc16cc-6d42-49f7-a6b7-c2afc8087761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:18 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Volume f7ca911e-84fe-4fea-aac1-4dddaef05142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7ca911e-84fe-4fea-aac1-4dddaef05142', 'volume_size': 1}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189907259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7ca911e-84fe-4fea-aac1-4dddaef05142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:19Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Creating volume f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:40:18 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:40:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:18 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 1073741824
Jul 06 13:40:18 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:19 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.634s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:40:19 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 1073741824" returned: 0 in 0.797s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:19 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142
Jul 06 13:40:19 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:20 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142" returned: 0 in 0.617s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdc16cc-6d42-49f7-a6b7-c2afc8087761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7ca911e-84fe-4fea-aac1-4dddaef05142', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23832c53-2f25-44cb-ba92-1869e4a0910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:20 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Volume volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 (f7ca911e-84fe-4fea-aac1-4dddaef05142): created successfully
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23832c53-2f25-44cb-ba92-1869e4a0910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (ab1294f6-ed0a-42d9-9837-5c13a6a8977f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:20 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b51e9a19-30d3-4179-8812-6fea9eefad9a tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 5cec81ca-1039-4ecd-bfb6-411415bb2238 of volume f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eb3e8a-ca4f-412b-83d1-cd283c3514f6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:20 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142
Jul 06 13:40:20 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:21 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:21 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 1G
Jul 06 13:40:21 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:22 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 1G" returned: 0 in 0.795s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:22 devstack sudo[105655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238
Jul 06 13:40:22 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:22 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238" returned: 0 in 0.638s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:22 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 is being set with open permissions: ugo+rw
Jul 06 13:40:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:22 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238
Jul 06 13:40:22 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:23 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238" returned: 0 in 0.597s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:23 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info
Jul 06 13:40:23 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:24 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info" returned: 0 in 0.625s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:24 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info is being set with open permissions: ugo+rw
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:24 devstack sudo[105667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info
Jul 06 13:40:24 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:24 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.info" returned: 0 in 0.616s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.065s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fc01479d-742e-4c60-a4fe-7b3ebbd35966 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-5cec81ca-1039-4ecd-bfb6-411415bb2238-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-5cec81ca-1039-4ecd-bfb6-411415bb2238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-5cec81ca-1039-4ecd-bfb6-411415bb2238" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-5cec81ca-1039-4ecd-bfb6-411415bb2238" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 5cec81ca-1039-4ecd-bfb6-411415bb2238 of volume f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:40:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[14518c07-0a37-482d-a3a1-f5a05e8e1f2b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:25 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238
Jul 06 13:40:25 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:25 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7ca911e-84fe-4fea-aac1-4dddaef05142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a2ed1-369a-4661-aca3-5066803d4e9e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:25 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142
Jul 06 13:40:25 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:26 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:26 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238
Jul 06 13:40:26 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:27 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238" returned: 0 in 0.694s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:27 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238
Jul 06 13:40:27 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:27 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142.5cec81ca-1039-4ecd-bfb6-411415bb2238" returned: 0 in 0.598s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-5cec81ca-1039-4ecd-bfb6-411415bb2238" released by "_delete_snapshot" :: held 2.834s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" released by "delete_snapshot" :: held 2.855s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Created reservations ['f4c33a24-d8b4-4efc-9778-b8bb61deea65', 'eefbee65-ba50-467c-a845-74d020dfca58', 'f839f314-ea9e-46b3-9222-a6a56896d5a2', 'cbd42d83-b976-43c9-b102-eec02d3f1c2d'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:27 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:40:27 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7b02ba58-5e3a-40e1-a91c-a31b8eba5b32 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-5cec81ca-1039-4ecd-bfb6-411415bb2238-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-f7ca911e-84fe-4fea-aac1-4dddaef05142-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f7ca911e-84fe-4fea-aac1-4dddaef05142-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" acquired by "delete_volume" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdbb98b-50a9-4041-85ee-a0f01a390fa7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:28 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142
Jul 06 13:40:28 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:28 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142" returned: 0 in 0.704s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:28 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142
Jul 06 13:40:28 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:29 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-f7ca911e-84fe-4fea-aac1-4dddaef05142" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f7ca911e-84fe-4fea-aac1-4dddaef05142" released by "delete_volume" :: held 1.380s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Created reservations ['76a54877-f1b0-43ba-b74a-0be64456c29d', '16bd4cf4-c70f-468f-907e-cc3ad6066332', 'a9071454-c99c-4f1c-b24f-aca8a52dd352', '2e2284ab-1d42-44c0-8532-e88bb16c7b73'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:29 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:29 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:30 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.638s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:30 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-13be9afd-8fc7-4d51-b8a4-3f1e83827df1 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f7ca911e-84fe-4fea-aac1-4dddaef05142-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (be2bfc01-e30f-465c-bd0d-12ab311b2e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85556d43-02f3-4007-8482-c0e4052ec654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85556d43-02f3-4007-8482-c0e4052ec654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106015640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234757d7-2bc0-43fc-bb70-737864a40547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:31Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e230afe-1bba-40fe-86c6-fc7b8a5d6099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e230afe-1bba-40fe-86c6-fc7b8a5d6099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23949e3-1fea-4485-8bf6-6d70f36ce872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c23949e3-1fea-4485-8bf6-6d70f36ce872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234757d7-2bc0-43fc-bb70-737864a40547', 'volume_name': 'volume-234757d7-2bc0-43fc-bb70-737864a40547', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ac6999-ff02-45de-8938-50808a98b4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ac6999-ff02-45de-8938-50808a98b4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e66a69-2a78-4176-a79a-0fea8d496b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:30 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Volume 234757d7-2bc0-43fc-bb70-737864a40547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234757d7-2bc0-43fc-bb70-737864a40547', 'volume_size': 1}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106015640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234757d7-2bc0-43fc-bb70-737864a40547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:31Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Creating volume 234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:40:30 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:40:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:30 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 1073741824
Jul 06 13:40:30 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:31 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 1073741824" returned: 0 in 0.777s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:31 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547
Jul 06 13:40:31 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:32 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547" returned: 0 in 0.627s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e66a69-2a78-4176-a79a-0fea8d496b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234757d7-2bc0-43fc-bb70-737864a40547', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d33070e-224d-4a2b-b293-2a070c1b8eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:32 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Volume volume-234757d7-2bc0-43fc-bb70-737864a40547 (234757d7-2bc0-43fc-bb70-737864a40547): created successfully
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d33070e-224d-4a2b-b293-2a070c1b8eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:32 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (be2bfc01-e30f-465c-bd0d-12ab311b2e9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-03cf3fa0-333b-4e5a-8b3f-e59a3dec888e tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 of volume 234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ec4362-108b-4e50-b3a7-6a215188b582]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:33 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547
Jul 06 13:40:33 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:33 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:33 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 1G
Jul 06 13:40:33 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:34 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 1G" returned: 0 in 0.772s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234757d7-2bc0-43fc-bb70-737864a40547 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:34 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234757d7-2bc0-43fc-bb70-737864a40547 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11
Jul 06 13:40:34 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:35 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234757d7-2bc0-43fc-bb70-737864a40547 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" returned: 0 in 0.664s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:35 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 is being set with open permissions: ugo+rw
Jul 06 13:40:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:35 devstack sudo[105726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11
Jul 06 13:40:35 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:35 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" returned: 0 in 0.631s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:35 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info
Jul 06 13:40:35 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:36 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info is being set with open permissions: ugo+rw
Jul 06 13:40:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:36 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info
Jul 06 13:40:36 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:37 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.info" returned: 0 in 0.625s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.141s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:37 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8340cdfb-a7f6-405b-8944-a7467c9249b7 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 of volume 234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c753f4-15b4-4251-a9d4-9f21d6261a43]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:38 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11
Jul 06 13:40:38 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:39 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" returned: 0 in 0.739s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234757d7-2bc0-43fc-bb70-737864a40547(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af7d26-dd44-4306-85bc-127b6199dcbf]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:39 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547
Jul 06 13:40:39 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:39 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:39 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11
Jul 06 13:40:39 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:40 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" returned: 0 in 0.828s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:40 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11
Jul 06 13:40:40 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:41 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547.f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" returned: 0 in 0.645s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11" released by "_delete_snapshot" :: held 3.023s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" released by "delete_snapshot" :: held 3.048s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:41 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Created reservations ['6cc0ab10-37e5-42ff-bf4c-1163a8263655', '63abd6a6-4c31-4a67-9026-6486ac410044', 'bc4373b7-fb55-4275-bb4f-d5a70a574a27', 'd5678fbc-f962-4050-9143-994afb94d41b'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:40:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-bf18dc3a-42e9-46c1-bcd2-dd075f318c25 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f8aa88e1-d8b2-4db0-abf7-f54133a7cc11-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-234757d7-2bc0-43fc-bb70-737864a40547-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "cinder-234757d7-2bc0-43fc-bb70-737864a40547-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" acquired by "delete_volume" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2a3468-7285-49b3-a3d8-25bb1b4814c7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:42 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547
Jul 06 13:40:42 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:43 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547" returned: 0 in 0.704s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:43 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547
Jul 06 13:40:43 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:43 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-234757d7-2bc0-43fc-bb70-737864a40547" returned: 0 in 0.608s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-234757d7-2bc0-43fc-bb70-737864a40547" released by "delete_volume" :: held 1.366s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Created reservations ['1d40c546-5415-43f0-bd4b-c56e6e9da088', '129d118e-6447-446e-ab93-fad2819d764a', 'f9a97114-d5fc-4522-9838-f7b957f436cc', '2b263e51-9b07-43e7-a562-0c35f226f962'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:44 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:44 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:44 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.609s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:44 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:40:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-8465ed84-52d1-4e65-b862-9c166df9325c tempest-ProjectMemberTests-1884173352 None] Lock "cinder-234757d7-2bc0-43fc-bb70-737864a40547-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (19e04fb1-ccbf-4674-bf19-6f081657e222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e37e96f-6de2-42c2-8d4c-8b817973d5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e37e96f-6de2-42c2-8d4c-8b817973d5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094633574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b068c-c526-421f-8510-cc5fbbe0b100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:45Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf8df58-ebd4-4efd-9fbe-460521e8e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf8df58-ebd4-4efd-9fbe-460521e8e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea9328-ff43-4d19-b6e3-a1d0ad816641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ea9328-ff43-4d19-b6e3-a1d0ad816641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4b068c-c526-421f-8510-cc5fbbe0b100', 'volume_name': 'volume-aa4b068c-c526-421f-8510-cc5fbbe0b100', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf3ad0e-595c-4c8d-b788-99a461aef922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf3ad0e-595c-4c8d-b788-99a461aef922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc48689-5009-4513-af56-77942a40ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:45 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Volume aa4b068c-c526-421f-8510-cc5fbbe0b100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4b068c-c526-421f-8510-cc5fbbe0b100', 'volume_size': 1}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094633574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4b068c-c526-421f-8510-cc5fbbe0b100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:45Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Creating volume aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:40:45 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:45 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 1073741824
Jul 06 13:40:45 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:45 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 1073741824" returned: 0 in 0.773s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:45 devstack sudo[105771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100
Jul 06 13:40:45 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:46 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100" returned: 0 in 0.641s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc48689-5009-4513-af56-77942a40ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4b068c-c526-421f-8510-cc5fbbe0b100', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f543ea1-73b5-4de8-82a8-88448b82aadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:46 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Volume volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 (aa4b068c-c526-421f-8510-cc5fbbe0b100): created successfully
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f543ea1-73b5-4de8-82a8-88448b82aadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:46 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (19e04fb1-ccbf-4674-bf19-6f081657e222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-c9ef0a68-786f-497b-9b7c-76751146cdc2 tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=110,cinder:INSERT=31,cinder:UPDATE=138,cinder:DELETE=9 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 81bfb2f9-07da-494d-8044-c0ed71e2f66b of volume aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87409da-7499-4651-a6ce-1a67ca771d2a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:47 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100
Jul 06 13:40:47 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:48 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:48 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b 1G
Jul 06 13:40:48 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:48 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b 1G" returned: 0 in 0.748s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:48 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b
Jul 06 13:40:48 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:49 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b" returned: 0 in 0.691s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:49 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b is being set with open permissions: ugo+rw
Jul 06 13:40:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:49 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b
Jul 06 13:40:49 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:50 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b" returned: 0 in 0.677s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:50 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=129,cinder:SELECT=84,cinder:INSERT=37,cinder:DELETE=13 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:40:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:50 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info
Jul 06 13:40:50 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:50 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info" returned: 0 in 0.626s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:50 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info is being set with open permissions: ugo+rw
Jul 06 13:40:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:50 devstack sudo[105796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info
Jul 06 13:40:50 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:51 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.info" returned: 0 in 0.666s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.220s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9725eebe-e789-41f4-90dd-3bea98438b27 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-81bfb2f9-07da-494d-8044-c0ed71e2f66b-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-81bfb2f9-07da-494d-8044-c0ed71e2f66b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-81bfb2f9-07da-494d-8044-c0ed71e2f66b" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-81bfb2f9-07da-494d-8044-c0ed71e2f66b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 81bfb2f9-07da-494d-8044-c0ed71e2f66b of volume aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2e2e8b-8ee7-4668-9ad1-8d3f61124f12]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:52 devstack sudo[105799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b
Jul 06 13:40:52 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:53 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa4b068c-c526-421f-8510-cc5fbbe0b100(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:40:53 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3816a08-cd4f-4bdc-b794-b2394901660f]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:53 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100
Jul 06 13:40:53 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:54 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100" returned: 0 in 0.704s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:54 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b
Jul 06 13:40:54 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:54 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:54 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b
Jul 06 13:40:54 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:55 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100.81bfb2f9-07da-494d-8044-c0ed71e2f66b" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-81bfb2f9-07da-494d-8044-c0ed71e2f66b" released by "_delete_snapshot" :: held 2.887s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" released by "delete_snapshot" :: held 2.909s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Created reservations ['feb7cb3d-8a92-4664-90a2-4bfaf0ef30eb', 'ebbffbc8-aa2b-495b-a638-56b3db4e9984', 'd1a8cb5c-abd7-40d1-b531-14a9ab803153', '5f648a37-86b3-472a-8b78-c66c30d8c7b6'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:55 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4d8ebce4-a41a-4886-838c-7c86360a7cd0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-81bfb2f9-07da-494d-8044-c0ed71e2f66b-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-aa4b068c-c526-421f-8510-cc5fbbe0b100-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-aa4b068c-c526-421f-8510-cc5fbbe0b100-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4efa23-cd4a-43a1-93ac-cd844fd387a5]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:40:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:55 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100
Jul 06 13:40:55 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:56 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:56 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100
Jul 06 13:40:56 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:57 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-aa4b068c-c526-421f-8510-cc5fbbe0b100" returned: 0 in 0.639s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-aa4b068c-c526-421f-8510-cc5fbbe0b100" released by "delete_volume" :: held 1.420s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Created reservations ['3dced6ea-a0fe-46f3-9644-3523c23d0d15', '885c0d6d-e018-4e7b-abd2-373ed905211b', 'f3807909-1462-4771-8849-f6ac224e5126', '2bcf2831-c856-4e59-b0c0-8c55416aafa7'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:57 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:40:57 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:57 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.643s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:40:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:40:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-cf47affa-50ab-4976-854b-b6004e0c1a39 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-aa4b068c-c526-421f-8510-cc5fbbe0b100-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (12417448-5446-4008-835e-30332248e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc009328-4195-4978-890e-5240416b79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc009328-4195-4978-890e-5240416b79cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10452624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d388f515-0d6c-43ac-a652-0f6cf530a567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:58Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24f37c5-9528-409a-a4d3-489d11492d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24f37c5-9528-409a-a4d3-489d11492d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a41d61-a234-4e82-a9a9-3952b6753d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a41d61-a234-4e82-a9a9-3952b6753d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd388f515-0d6c-43ac-a652-0f6cf530a567', 'volume_name': 'volume-d388f515-0d6c-43ac-a652-0f6cf530a567', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893856c3-7633-4b32-838e-6f200506929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893856c3-7633-4b32-838e-6f200506929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1609ac0-69ab-4ec1-8ea7-ee28a51448c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:58 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Volume d388f515-0d6c-43ac-a652-0f6cf530a567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d388f515-0d6c-43ac-a652-0f6cf530a567', 'volume_size': 1}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10452624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d388f515-0d6c-43ac-a652-0f6cf530a567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:40:58Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Creating volume d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:40:58 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:40:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:58 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 1073741824
Jul 06 13:40:58 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:59 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 1073741824" returned: 0 in 0.790s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:40:59 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567
Jul 06 13:40:59 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:40:59 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567" returned: 0 in 0.606s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1609ac0-69ab-4ec1-8ea7-ee28a51448c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d388f515-0d6c-43ac-a652-0f6cf530a567', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac13af-aafd-4e20-8e5e-0b2c1b2d58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:40:59 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Volume volume-d388f515-0d6c-43ac-a652-0f6cf530a567 (d388f515-0d6c-43ac-a652-0f6cf530a567): created successfully
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ac13af-aafd-4e20-8e5e-0b2c1b2d58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:40:59 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (12417448-5446-4008-835e-30332248e218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:40:59 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9508205d-b4fa-47d1-87f4-a69cc3bd1f08 tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:41:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 133b9d7d-b495-4de2-b3ea-e8d8162f46c7 of volume d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:41:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[5360772f-e901-45bc-b251-c3f73e641006]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:00 devstack sudo[105838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567
Jul 06 13:41:00 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:01 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:01 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 1G
Jul 06 13:41:01 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:02 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 1G" returned: 0 in 0.752s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d388f515-0d6c-43ac-a652-0f6cf530a567 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:02 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d388f515-0d6c-43ac-a652-0f6cf530a567 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7
Jul 06 13:41:02 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:02 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d388f515-0d6c-43ac-a652-0f6cf530a567 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7" returned: 0 in 0.667s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:02 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 is being set with open permissions: ugo+rw
Jul 06 13:41:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:02 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7
Jul 06 13:41:02 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:03 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7" returned: 0 in 0.676s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:03 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info
Jul 06 13:41:03 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:04 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info" returned: 0 in 0.657s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:04 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info is being set with open permissions: ugo+rw
Jul 06 13:41:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:04 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info
Jul 06 13:41:04 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:04 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.info" returned: 0 in 0.640s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.201s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7225e209-94d9-47fc-bb1a-ca3ad7f1607e tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-133b9d7d-b495-4de2-b3ea-e8d8162f46c7-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-133b9d7d-b495-4de2-b3ea-e8d8162f46c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-133b9d7d-b495-4de2-b3ea-e8d8162f46c7" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-133b9d7d-b495-4de2-b3ea-e8d8162f46c7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 133b9d7d-b495-4de2-b3ea-e8d8162f46c7 of volume d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7538bf-46f8-4bc8-aa8d-41b33360742a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:06 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7
Jul 06 13:41:06 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:06 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7" returned: 0 in 0.744s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:06 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d388f515-0d6c-43ac-a652-0f6cf530a567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:41:06 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca9871-8b2a-42e6-a2b4-289235a61539]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:06 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567
Jul 06 13:41:06 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:07 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567" returned: 0 in 0.775s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:07 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7
Jul 06 13:41:07 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:08 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:08 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7
Jul 06 13:41:08 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:08 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567.133b9d7d-b495-4de2-b3ea-e8d8162f46c7" returned: 0 in 0.639s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-133b9d7d-b495-4de2-b3ea-e8d8162f46c7" released by "_delete_snapshot" :: held 2.970s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" released by "delete_snapshot" :: held 2.996s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:08 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Created reservations ['4943c682-f331-4306-9ace-8cf9d01eace1', '5e03158a-d2ae-4c5f-ae0a-d3ec01ab9952', '3427d21b-2a56-4d84-a9ba-60c8c6c07192', '8afe4129-d201-4c01-8fcb-de18a9149784'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:08 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-4c17d85e-9104-4ff6-8e5d-7137e12bff91 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-133b9d7d-b495-4de2-b3ea-e8d8162f46c7-delete_snapshot" released by "delete_snapshot" :: held 3.131s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-d388f515-0d6c-43ac-a652-0f6cf530a567-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-d388f515-0d6c-43ac-a652-0f6cf530a567-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" acquired by "delete_volume" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe2b10-6a0d-4a18-8565-f10ae22d827a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:09 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567
Jul 06 13:41:09 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:09 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:09 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567
Jul 06 13:41:09 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:10 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-d388f515-0d6c-43ac-a652-0f6cf530a567" returned: 0 in 0.675s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-d388f515-0d6c-43ac-a652-0f6cf530a567" released by "delete_volume" :: held 1.482s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Created reservations ['c63e9cc1-41f2-4b00-ae43-f887108b0bd0', '0a403ca1-8bc1-4c62-a249-2e1033101b29', '4844b095-14c5-4119-95a2-3cf1bf84755f', 'b8a73d12-8b93-454a-9e35-24f91d2b1bb4'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:10 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:41:10 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:11 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.656s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:41:11 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-71b6cff3-5e9b-4f28-a2a4-3111c3ba9d9e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-d388f515-0d6c-43ac-a652-0f6cf530a567-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (a5e2794b-2183-42b5-8e08-04199c0e994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0853d47b-b5f0-4067-9820-002fe5a418d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0853d47b-b5f0-4067-9820-002fe5a418d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697266150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850c585-e56f-48dd-bc5e-f7c62ea62e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:12Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195c94df-0d4d-409a-a6a2-9e079094b0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195c94df-0d4d-409a-a6a2-9e079094b0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40330607-f4b1-49b6-9114-15ffffc332a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40330607-f4b1-49b6-9114-15ffffc332a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6850c585-e56f-48dd-bc5e-f7c62ea62e6c', 'volume_name': 'volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e54ddf-65ca-485f-b582-e6904c54c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e54ddf-65ca-485f-b582-e6904c54c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f265dbb-d2f1-4aab-beb4-0b45910587d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:11 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Volume 6850c585-e56f-48dd-bc5e-f7c62ea62e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c', 'volume_size': 1}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697266150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6850c585-e56f-48dd-bc5e-f7c62ea62e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:12Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Creating volume 6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:41:11 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:41:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:11 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c 1073741824
Jul 06 13:41:11 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:12 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c 1073741824" returned: 0 in 0.799s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:12 devstack sudo[105897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c
Jul 06 13:41:12 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:13 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f265dbb-d2f1-4aab-beb4-0b45910587d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48064ae3-697e-42a9-89f5-441b6cb654e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:13 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Volume volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c (6850c585-e56f-48dd-bc5e-f7c62ea62e6c): created successfully
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48064ae3-697e-42a9-89f5-441b6cb654e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (a5e2794b-2183-42b5-8e08-04199c0e994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-522e7c8d-8d9a-4a93-92a4-bdf64d8364ec tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:14 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 8f06ad03-87da-48d9-8ec9-fde1849ac154 of volume 6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:41:14 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a41791-9326-4969-b2d5-2092384c8ff2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:14 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c
Jul 06 13:41:14 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:14 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" returned: 0 in 0.701s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:14 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 1G
Jul 06 13:41:14 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:15 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 1G" returned: 0 in 0.821s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:15 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154
Jul 06 13:41:15 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:16 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:16 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 is being set with open permissions: ugo+rw
Jul 06 13:41:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:16 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154
Jul 06 13:41:16 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:16 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154" returned: 0 in 0.639s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:16 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info
Jul 06 13:41:16 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:17 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info" returned: 0 in 0.630s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:17 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info is being set with open permissions: ugo+rw
Jul 06 13:41:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:17 devstack sudo[105960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info
Jul 06 13:41:17 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:18 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.info" returned: 0 in 0.653s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5186dcc4-7730-4811-b2db-d2a46bcf1b4a tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:18 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:41:18 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:19 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.632s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-8f06ad03-87da-48d9-8ec9-fde1849ac154-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-8f06ad03-87da-48d9-8ec9-fde1849ac154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-8f06ad03-87da-48d9-8ec9-fde1849ac154" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8f06ad03-87da-48d9-8ec9-fde1849ac154" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 8f06ad03-87da-48d9-8ec9-fde1849ac154 of volume 6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a5362c-84d6-481a-99d6-9e95647b8f7b]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:19 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154
Jul 06 13:41:19 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:20 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154" returned: 0 in 0.771s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[97945733-64f3-4570-9d22-d3a88ca13986]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:20 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c
Jul 06 13:41:20 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:20 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" returned: 0 in 0.769s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:20 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154
Jul 06 13:41:20 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:21 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154" returned: 0 in 0.718s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:21 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154
Jul 06 13:41:21 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:22 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c.8f06ad03-87da-48d9-8ec9-fde1849ac154" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8f06ad03-87da-48d9-8ec9-fde1849ac154" released by "_delete_snapshot" :: held 2.967s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" released by "delete_snapshot" :: held 2.989s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Created reservations ['da9124b0-00cf-4f50-908e-88eedd88f904', 'd52e10b3-d87b-4873-92a4-e1b879bd11cb', '3556f597-7e6a-4076-a07d-0844a7887088', '94cd985c-db51-4168-b729-9caeb7b5c812'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:22 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-da482fb1-e3c9-4afb-a86e-5a4ba8715597 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-8f06ad03-87da-48d9-8ec9-fde1849ac154-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-6850c585-e56f-48dd-bc5e-f7c62ea62e6c-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-6850c585-e56f-48dd-bc5e-f7c62ea62e6c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" acquired by "delete_volume" :: waited 0.012s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477342d-06dc-434e-8620-f36d14746f63]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:22 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c
Jul 06 13:41:22 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:23 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:23 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c
Jul 06 13:41:23 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:23 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" returned: 0 in 0.661s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:23 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-6850c585-e56f-48dd-bc5e-f7c62ea62e6c" released by "delete_volume" :: held 1.446s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:23 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Created reservations ['fb89a042-9b36-402b-a97a-2ff3665366b4', '87749bb6-479d-4035-b2a6-5e7614da19a7', '5f5bf946-82ba-488f-9afd-dbecff303f88', '0ea9d8bf-d96d-408d-96c8-6af2bcef9bcf'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:24 devstack sudo[105999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:41:24 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:24 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.646s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:41:24 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:41:24 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-808123a2-cb51-4b9e-b2bf-c51d19ab72f0 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-6850c585-e56f-48dd-bc5e-f7c62ea62e6c-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (511d2ffa-7827-4b6d-a597-31820e828b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae8bcb5-7a29-4cb9-9bb3-c9b1631a96a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae8bcb5-7a29-4cb9-9bb3-c9b1631a96a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236379879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7bd27-7d24-443f-a038-4b98bb682f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:25Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e74cca-30bc-4a8d-b209-4fa5a3ef8011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e74cca-30bc-4a8d-b209-4fa5a3ef8011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f946f995-3423-449e-af8b-1bf74e0b3efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f946f995-3423-449e-af8b-1bf74e0b3efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb7bd27-7d24-443f-a038-4b98bb682f51', 'volume_name': 'volume-1eb7bd27-7d24-443f-a038-4b98bb682f51', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b6d8c2-dd36-4a25-97e0-5740af3d9f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b6d8c2-dd36-4a25-97e0-5740af3d9f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebe156d-2b5a-4ba7-aa38-1056b6dec6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:25 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Volume 1eb7bd27-7d24-443f-a038-4b98bb682f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb7bd27-7d24-443f-a038-4b98bb682f51', 'volume_size': 1}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-236379879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7bd27-7d24-443f-a038-4b98bb682f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:25Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Creating volume 1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:41:25 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:41:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:25 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 1073741824
Jul 06 13:41:25 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:26 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 1073741824" returned: 0 in 0.861s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:26 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51
Jul 06 13:41:26 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:26 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51" returned: 0 in 0.661s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebe156d-2b5a-4ba7-aa38-1056b6dec6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb7bd27-7d24-443f-a038-4b98bb682f51', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18428988-f20f-47a9-99dd-c6b4e66ae143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:26 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Volume volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 (1eb7bd27-7d24-443f-a038-4b98bb682f51): created successfully
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18428988-f20f-47a9-99dd-c6b4e66ae143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:26 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (511d2ffa-7827-4b6d-a597-31820e828b88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:26 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-4f94c69e-bdec-4928-8b71-8d90c92053fc tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:41:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:27 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot f24b25c9-b007-4933-817a-76910c27484d of volume 1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:41:27 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed96d995-0f04-468c-9eee-11fd725934c8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:27 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51
Jul 06 13:41:27 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:28 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51" returned: 0 in 0.738s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:28 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d 1G
Jul 06 13:41:28 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:28 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d 1G" returned: 0 in 0.773s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:28 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d
Jul 06 13:41:28 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:29 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d" returned: 0 in 0.659s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:29 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d is being set with open permissions: ugo+rw
Jul 06 13:41:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:29 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d
Jul 06 13:41:29 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:30 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d" returned: 0 in 0.619s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:30 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info
Jul 06 13:41:30 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:30 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info" returned: 0 in 0.634s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:30 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info is being set with open permissions: ugo+rw
Jul 06 13:41:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:30 devstack sudo[106035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info
Jul 06 13:41:30 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:31 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.info" returned: 0 in 0.623s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:31 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3e959f6b-a512-4c97-b10c-f093789a9ae3 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-f24b25c9-b007-4933-817a-76910c27484d-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f24b25c9-b007-4933-817a-76910c27484d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-f24b25c9-b007-4933-817a-76910c27484d" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f24b25c9-b007-4933-817a-76910c27484d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot f24b25c9-b007-4933-817a-76910c27484d of volume 1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8867848c-7f1e-4dc9-9898-897cfaf5497c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:32 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d
Jul 06 13:41:32 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:33 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb7bd27-7d24-443f-a038-4b98bb682f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:41:33 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f8a7d-e5a0-452e-97a9-7a03de05daa8]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:33 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51
Jul 06 13:41:33 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:34 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51" returned: 0 in 0.753s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:34 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d
Jul 06 13:41:34 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:34 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d" returned: 0 in 0.698s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:34 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d
Jul 06 13:41:34 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:35 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51.f24b25c9-b007-4933-817a-76910c27484d" returned: 0 in 0.662s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-f24b25c9-b007-4933-817a-76910c27484d" released by "_delete_snapshot" :: held 2.927s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" released by "delete_snapshot" :: held 2.947s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Created reservations ['9d03ad00-e016-4ef0-bf62-ec0208a55e62', '2a50a036-e8d1-4d4e-a7c4-507ca5382ad7', 'a3b14973-6322-4f28-8ad0-bb20bfe38de5', '42b06c4c-c862-448d-a7b7-8b2a0a92a3c1'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:35 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-403cfd0d-e414-4013-a232-f0716943f94e tempest-ProjectMemberTests-1884173352 None] Lock "cinder-f24b25c9-b007-4933-817a-76910c27484d-delete_snapshot" released by "delete_snapshot" :: held 3.094s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-1eb7bd27-7d24-443f-a038-4b98bb682f51-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-1eb7bd27-7d24-443f-a038-4b98bb682f51-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" acquired by "delete_volume" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcffdd63-faed-44dd-89d5-bb9e121ab6e9]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:35 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51
Jul 06 13:41:35 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:36 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51" returned: 0 in 0.716s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:36 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51
Jul 06 13:41:36 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:37 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-1eb7bd27-7d24-443f-a038-4b98bb682f51" returned: 0 in 0.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-1eb7bd27-7d24-443f-a038-4b98bb682f51" released by "delete_volume" :: held 1.393s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Created reservations ['cf206ac1-dc85-44ac-bd68-c3439498d865', 'b1988f6f-af3b-4e76-878f-ef96b4add493', 'c81c4956-3eec-4ef8-a082-ca413062beb4', '2a350df8-e276-40f5-a051-f92bac0721ea'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:37 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:41:37 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:37 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.657s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:37 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:41:38 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-523ec34b-9035-4b4b-b5b6-bc2edddc39d7 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-1eb7bd27-7d24-443f-a038-4b98bb682f51-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (0ad9ffd9-4a2e-4ce3-8d57-1e0897437df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda4bcfa-5528-4a9b-bb8d-9074c5065ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda4bcfa-5528-4a9b-bb8d-9074c5065ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906386643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd4303e-bfaf-4f7e-994f-ee0fe61df54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:38Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef513b-e519-4a41-b860-825965e5a26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ef513b-e519-4a41-b860-825965e5a26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59700866-d90e-40da-8416-f42904bafa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59700866-d90e-40da-8416-f42904bafa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd4303e-bfaf-4f7e-994f-ee0fe61df54a', 'volume_name': 'volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ae9990-7c62-4bb4-b455-e7967ccdd909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ae9990-7c62-4bb4-b455-e7967ccdd909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74059aee-744c-4c58-a63e-1e1f82f19126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:38 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Volume 8fd4303e-bfaf-4f7e-994f-ee0fe61df54a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a', 'volume_size': 1}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-906386643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd4303e-bfaf-4f7e-994f-ee0fe61df54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:38Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Creating volume 8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:41:38 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:41:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:38 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a 1073741824
Jul 06 13:41:38 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:39 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a 1073741824" returned: 0 in 0.767s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:39 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a
Jul 06 13:41:39 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:39 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" returned: 0 in 0.651s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74059aee-744c-4c58-a63e-1e1f82f19126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb0fd62-bd3c-4178-afcc-637a57ad6439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:39 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Volume volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a (8fd4303e-bfaf-4f7e-994f-ee0fe61df54a): created successfully
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbb0fd62-bd3c-4178-afcc-637a57ad6439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:39 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (0ad9ffd9-4a2e-4ce3-8d57-1e0897437df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:39 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-74e151ac-3f63-4ce6-8e42-934dccb2a1d1 tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:41:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:40 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot fb4262e8-0ed0-448f-a417-31a403ca5551 of volume 8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:41:40 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecf763f-d92a-429b-9f25-18af7ca3a78c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:40 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a
Jul 06 13:41:40 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:41 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" returned: 0 in 0.731s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:41 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 1G
Jul 06 13:41:41 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:42 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 1G" returned: 0 in 0.789s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:42 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551
Jul 06 13:41:42 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:42 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551" returned: 0 in 0.667s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:42 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 is being set with open permissions: ugo+rw
Jul 06 13:41:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:42 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551
Jul 06 13:41:42 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:43 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551" returned: 0 in 0.625s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:43 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info
Jul 06 13:41:43 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:44 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info" returned: 0 in 0.612s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:44 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info is being set with open permissions: ugo+rw
Jul 06 13:41:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:44 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info
Jul 06 13:41:44 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:44 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.info" returned: 0 in 0.605s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.103s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f0a8c51f-2e05-4298-8ad6-3dde5210d843 tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-fb4262e8-0ed0-448f-a417-31a403ca5551-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-fb4262e8-0ed0-448f-a417-31a403ca5551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-fb4262e8-0ed0-448f-a417-31a403ca5551" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-fb4262e8-0ed0-448f-a417-31a403ca5551" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot fb4262e8-0ed0-448f-a417-31a403ca5551 of volume 8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5255f4-90cc-45cc-89e8-42a0afd4914c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:46 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551
Jul 06 13:41:46 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:46 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551" returned: 0 in 0.704s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:41:46 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08fb66-78e9-44f0-a131-fd9c17ae1ba0]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:46 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a
Jul 06 13:41:46 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:47 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" returned: 0 in 0.717s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:47 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551
Jul 06 13:41:47 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:48 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551" returned: 0 in 0.727s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:48 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551
Jul 06 13:41:48 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:48 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a.fb4262e8-0ed0-448f-a417-31a403ca5551" returned: 0 in 0.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-fb4262e8-0ed0-448f-a417-31a403ca5551" released by "_delete_snapshot" :: held 2.840s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" released by "delete_snapshot" :: held 2.903s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=56,cinder:UPDATE=77,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Created reservations ['7b91fd59-2877-462a-a2dc-412fae83c2ec', '2881ceaf-1b68-499a-ab41-9e2a71bdd76b', '314add53-a712-4c5b-a3ec-4d26f09199cf', 'd442d099-233e-4298-9441-d115e6697f66'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:41:48 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-3bec2966-4507-42a1-bcdf-44dc13958219 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-fb4262e8-0ed0-448f-a417-31a403ca5551-delete_snapshot" released by "delete_snapshot" :: held 3.037s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" acquired by "delete_volume" :: waited 0.012s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c861fada-561f-42bf-b68f-6339d31ab495]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:49 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a
Jul 06 13:41:49 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:49 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" returned: 0 in 0.741s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:49 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a
Jul 06 13:41:49 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:50 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" returned: 0 in 0.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a" released by "delete_volume" :: held 1.402s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:DELETE=6,cinder:SELECT=67,cinder:INSERT=19,cinder:UPDATE=77 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Created reservations ['bcba86f1-8e3e-4bf9-8c30-db3adffaeffb', '81b4d3e1-b12b-4405-9156-942892616ab2', '02feef15-98eb-494b-8b20-2799825af574', 'b41abf51-3611-4681-8e8b-27fea95f91fb'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:50 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:41:50 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:51 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.607s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:41:51 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-fd8dc704-9a32-4066-bcf5-2344552d9e07 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-8fd4303e-bfaf-4f7e-994f-ee0fe61df54a-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (8407ee1d-4061-40af-a1e9-5666915272ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da340c8e-38f9-46d8-ae90-35556c153a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da340c8e-38f9-46d8-ae90-35556c153a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871012355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a85fe0-eda4-4006-8668-235300fbfebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:52Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107a5775-8bc3-4f9d-b467-70cb76280646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107a5775-8bc3-4f9d-b467-70cb76280646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a4a449-dd5a-4009-8824-2f6ba92debff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a4a449-dd5a-4009-8824-2f6ba92debff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a85fe0-eda4-4006-8668-235300fbfebe', 'volume_name': 'volume-44a85fe0-eda4-4006-8668-235300fbfebe', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4508420-0ea9-4356-8863-7d826e4dfa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4508420-0ea9-4356-8863-7d826e4dfa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15064ba6-b2ab-471f-b135-52d25e97f994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:51 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Volume 44a85fe0-eda4-4006-8668-235300fbfebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a85fe0-eda4-4006-8668-235300fbfebe', 'volume_size': 1}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-871012355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a85fe0-eda4-4006-8668-235300fbfebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90b87f2b4e94f9d95417cc846ab3f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:41:52Z,use_quota=True,user_id='05e4eb8e75da47868ba0f3183e3e4d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Creating volume 44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:41:51 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:41:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:51 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe 1073741824
Jul 06 13:41:51 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:52 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe 1073741824" returned: 0 in 0.805s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:52 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe
Jul 06 13:41:52 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:53 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe" returned: 0 in 0.616s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15064ba6-b2ab-471f-b135-52d25e97f994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a85fe0-eda4-4006-8668-235300fbfebe', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaca720-de81-4a4e-b3ee-6ac42bdf2bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:41:53 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Volume volume-44a85fe0-eda4-4006-8668-235300fbfebe (44a85fe0-eda4-4006-8668-235300fbfebe): created successfully
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaca720-de81-4a4e-b3ee-6ac42bdf2bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Flow 'volume_create_manager' (8407ee1d-4061-40af-a1e9-5666915272ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:41:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6be0a58b-59c0-4d5d-a3a6-672aa1c00308 tempest-ProjectMemberTests-1884173352 None] Created volume successfully.
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Creating offline snapshot 2565dd52-a8b6-415c-8767-a710a54e022b of volume 44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a2f3ed-124c-4484-9a20-7af3555d94c6]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:54 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe
Jul 06 13:41:54 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:54 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe" returned: 0 in 0.705s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:54 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b 1G
Jul 06 13:41:54 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:55 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b 1G" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a85fe0-eda4-4006-8668-235300fbfebe -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:55 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a85fe0-eda4-4006-8668-235300fbfebe -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b
Jul 06 13:41:55 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:56 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a85fe0-eda4-4006-8668-235300fbfebe -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b" returned: 0 in 0.648s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:56 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b is being set with open permissions: ugo+rw
Jul 06 13:41:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:56 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b
Jul 06 13:41:56 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:56 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b" returned: 0 in 0.656s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:56 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info
Jul 06 13:41:56 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:57 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info" returned: 0 in 0.644s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:57 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info is being set with open permissions: ugo+rw
Jul 06 13:41:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:57 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info
Jul 06 13:41:57 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:41:57 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Jul 06 13:41:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.info" returned: 0 in 0.627s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:41:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.125s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:41:58 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-f7e36f52-ec76-45ad-aa25-fa9658156a2e tempest-ProjectMemberTests-1884173352 None] Create snapshot completed successfully
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-2565dd52-a8b6-415c-8767-a710a54e022b-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-2565dd52-a8b6-415c-8767-a710a54e022b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-2565dd52-a8b6-415c-8767-a710a54e022b" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-2565dd52-a8b6-415c-8767-a710a54e022b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Deleting offline snapshot 2565dd52-a8b6-415c-8767-a710a54e022b of volume 44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] snapshot_file for this snap is: volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27425b8-fdfe-4965-b5e3-c4366c8e410c]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:41:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:41:59 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b
Jul 06 13:41:59 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:00 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a85fe0-eda4-4006-8668-235300fbfebe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85cc207-3768-432a-ba2a-336101a97267]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:00 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe
Jul 06 13:42:00 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:00 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe" returned: 0 in 0.747s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:00 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b
Jul 06 13:42:00 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:01 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b" returned: 0 in 0.714s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:01 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b
Jul 06 13:42:01 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:02 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe.2565dd52-a8b6-415c-8767-a710a54e022b" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-2565dd52-a8b6-415c-8767-a710a54e022b" released by "_delete_snapshot" :: held 2.893s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" released by "delete_snapshot" :: held 2.916s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Created reservations ['3832d1e0-994d-4356-8b63-fd42a76a1d30', 'c94d65ba-953a-4b29-a84d-5d21aae7e0c6', '254ca953-853d-4f06-8ac1-f8ff9f0b7a06', 'f6ecc2ea-00d0-4470-9789-de2cb6a37a81'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Delete snapshot completed successfully.
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-9e224118-084d-413a-807e-6af532795764 tempest-ProjectMemberTests-1884173352 None] Lock "cinder-2565dd52-a8b6-415c-8767-a710a54e022b-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-44a85fe0-eda4-4006-8668-235300fbfebe-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "cinder-44a85fe0-eda4-4006-8668-235300fbfebe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Acquiring lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" acquired by "delete_volume" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9502ca27-7bd4-4bc2-b30b-6e3fae67546a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:02 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe
Jul 06 13:42:02 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:03 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:03 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe
Jul 06 13:42:03 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:03 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-44a85fe0-eda4-4006-8668-235300fbfebe" returned: 0 in 0.640s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "cinder-quobyte-44a85fe0-eda4-4006-8668-235300fbfebe" released by "delete_volume" :: held 1.422s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Created reservations ['f1e56d45-6eda-4ccb-8f92-f954e7ef3541', 'd9494793-79cf-4fcc-aca5-23c0583a2479', '333b27d7-958d-4d92-b34c-620c201b7caf', 'df1e41cc-cac8-44d0-95e4-c1973d36a84a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:04 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:04 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:04 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.636s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:04 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:42:04 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Deleted volume successfully.
Jul 06 13:42:04 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-6f840923-1168-4f0f-8656-eac03d880faf tempest-ProjectMemberTests-1884173352 None] Lock "cinder-44a85fe0-eda4-4006-8668-235300fbfebe-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (c4d03729-11d3-4287-b67f-631b7abda2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f317200-fd7b-406e-8e2e-e8d69413c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f317200-fd7b-406e-8e2e-e8d69413c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930190209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7747a1-fd04-4629-b373-2ce2357fca35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:08Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b734d2b4-00a3-4a61-bf70-4626309dc481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b734d2b4-00a3-4a61-bf70-4626309dc481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623f69de-2f68-42bb-8c27-f5a64e0ada68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623f69de-2f68-42bb-8c27-f5a64e0ada68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7747a1-fd04-4629-b373-2ce2357fca35', 'volume_name': 'volume-0a7747a1-fd04-4629-b373-2ce2357fca35', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd85fa11-70ff-4b74-b9d8-a74701b52558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd85fa11-70ff-4b74-b9d8-a74701b52558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bd2e34-6e4d-4a5d-9149-63af86ed0730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:08 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Volume 0a7747a1-fd04-4629-b373-2ce2357fca35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7747a1-fd04-4629-b373-2ce2357fca35', 'volume_size': 1}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1930190209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7747a1-fd04-4629-b373-2ce2357fca35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:08Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Creating volume 0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:42:08 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:42:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:08 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 1073741824
Jul 06 13:42:08 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 1073741824" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:09 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35
Jul 06 13:42:09 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:09 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35" returned: 0 in 0.640s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bd2e34-6e4d-4a5d-9149-63af86ed0730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7747a1-fd04-4629-b373-2ce2357fca35', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11591b1-6e35-4045-93e8-3c28dbbb586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:09 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Volume volume-0a7747a1-fd04-4629-b373-2ce2357fca35 (0a7747a1-fd04-4629-b373-2ce2357fca35): created successfully
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11591b1-6e35-4045-93e8-3c28dbbb586a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:09 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (c4d03729-11d3-4287-b67f-631b7abda2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:09 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-daaf9559-d7e9-474f-926c-b706fd7f8cc4 tempest-ProjectReaderTests-1875204325 None] Created volume successfully.
Jul 06 13:42:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:10 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Creating offline snapshot 9e3e3cc0-68a1-4f62-b0ba-714e7a57986f of volume 0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:42:10 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db0b904-3860-4d3d-8b42-06da8e1b7201]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:10 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35
Jul 06 13:42:10 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:11 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35" returned: 0 in 0.724s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:11 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f 1G
Jul 06 13:42:11 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:12 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f 1G" returned: 0 in 0.776s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7747a1-fd04-4629-b373-2ce2357fca35 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:12 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7747a1-fd04-4629-b373-2ce2357fca35 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f
Jul 06 13:42:12 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:12 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7747a1-fd04-4629-b373-2ce2357fca35 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" returned: 0 in 0.662s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:12 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f is being set with open permissions: ugo+rw
Jul 06 13:42:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:12 devstack sudo[106219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f
Jul 06 13:42:12 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:13 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" returned: 0 in 0.619s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:13 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info
Jul 06 13:42:13 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:13 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info" returned: 0 in 0.605s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:13 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info is being set with open permissions: ugo+rw
Jul 06 13:42:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:13 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info
Jul 06 13:42:13 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:14 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.info" returned: 0 in 0.611s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:14 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.074s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:14 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-65a0b745-cc1e-43ed-96c2-0226a9b552f7 tempest-ProjectReaderTests-1875204325 None] Create snapshot completed successfully
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Deleting offline snapshot 9e3e3cc0-68a1-4f62-b0ba-714e7a57986f of volume 0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] snapshot_file for this snap is: volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a29941d-9144-480c-94cb-92703e0adf42]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:15 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:16 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f
Jul 06 13:42:16 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:16 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" returned: 0 in 0.762s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:16 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a7747a1-fd04-4629-b373-2ce2357fca35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:42:16 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1092edcf-6be7-4506-9355-5746ad7ede32]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:16 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:16 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35
Jul 06 13:42:16 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:17 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35" returned: 0 in 0.738s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:17 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:17 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f
Jul 06 13:42:17 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:18 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" returned: 0 in 0.697s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:18 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f
Jul 06 13:42:18 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:18 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:18 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:18 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35.9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" returned: 0 in 0.615s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f" released by "_delete_snapshot" :: held 2.903s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" released by "delete_snapshot" :: held 2.933s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Created reservations ['094400f7-2c0c-4a84-8273-6f743afb33a5', '0e9d4ea0-2a14-4f1c-b246-11e1763de4f4', '02437d60-39d6-4ebf-a07f-5b4ca3a88554', 'fa3d6bba-e9b4-4590-8623-c79061f4cd6a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:18 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Delete snapshot completed successfully.
Jul 06 13:42:18 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-d6548a5e-1fd0-484c-9c09-f486048be2f0 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-9e3e3cc0-68a1-4f62-b0ba-714e7a57986f-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-0a7747a1-fd04-4629-b373-2ce2357fca35-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-0a7747a1-fd04-4629-b373-2ce2357fca35-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:19 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.640s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cde7df2-2c06-4897-bfe3-22a4fe6044f2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:19 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35
Jul 06 13:42:19 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:19 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35" returned: 0 in 0.719s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:19 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35
Jul 06 13:42:19 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:20 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-0a7747a1-fd04-4629-b373-2ce2357fca35" returned: 0 in 0.612s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-0a7747a1-fd04-4629-b373-2ce2357fca35" released by "delete_volume" :: held 1.381s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Created reservations ['1be62d4b-e382-42f1-a51e-7d4583dad27a', 'bd54daeb-ed9f-4729-ab9a-646be2e262b8', '112156c0-de7e-4f38-be32-76caec897478', '366e29a0-92a8-4923-a485-6008cfbf0459'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:20 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:20 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:20 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:21 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.619s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:42:21 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Deleted volume successfully.
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-b1632383-dd71-4e6d-b308-4f02b64bf05e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-0a7747a1-fd04-4629-b373-2ce2357fca35-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (6b44176f-adbc-45d4-b9c1-4b3d56bd3192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299047a3-9dd9-4ed8-878f-175bf0f35612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (299047a3-9dd9-4ed8-878f-175bf0f35612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126718066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d92547-febc-4f87-a173-f2f2a7acdac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:22Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdde6884-7495-487d-9717-3ceac4da592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdde6884-7495-487d-9717-3ceac4da592d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afe5f7e-7a24-4ea1-a021-9459f96fb5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afe5f7e-7a24-4ea1-a021-9459f96fb5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d92547-febc-4f87-a173-f2f2a7acdac1', 'volume_name': 'volume-57d92547-febc-4f87-a173-f2f2a7acdac1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67be8bf-2e7b-481d-acd0-bf83e0aeaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67be8bf-2e7b-481d-acd0-bf83e0aeaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c753e2-5329-408f-b890-e4f2a0cbd98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:21 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Volume 57d92547-febc-4f87-a173-f2f2a7acdac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d92547-febc-4f87-a173-f2f2a7acdac1', 'volume_size': 1}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126718066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d92547-febc-4f87-a173-f2f2a7acdac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:22Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Creating volume 57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:42:21 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:42:21 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:21 devstack sudo[106304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 1073741824
Jul 06 13:42:21 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:22 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 1073741824" returned: 0 in 0.791s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:22 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:22 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1
Jul 06 13:42:22 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:23 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1" returned: 0 in 0.633s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c753e2-5329-408f-b890-e4f2a0cbd98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d92547-febc-4f87-a173-f2f2a7acdac1', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4e0b8a-f0f2-4b4a-96f8-c751070a8273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:23 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Volume volume-57d92547-febc-4f87-a173-f2f2a7acdac1 (57d92547-febc-4f87-a173-f2f2a7acdac1): created successfully
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4e0b8a-f0f2-4b4a-96f8-c751070a8273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (6b44176f-adbc-45d4-b9c1-4b3d56bd3192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:23 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-de8efb23-2aa4-4036-945d-a8cc9eaa464d tempest-ProjectReaderTests-1875204325 None] Created volume successfully.
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Creating offline snapshot d6fa6d13-6164-4c38-8689-988cfaa836ac of volume 57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e5342-dac7-4df6-b1c8-cf1f396aa7cd]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:23 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:24 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1
Jul 06 13:42:24 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:24 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1" returned: 0 in 0.723s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:24 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:24 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac 1G
Jul 06 13:42:24 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:25 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac 1G" returned: 0 in 0.792s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:25 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d92547-febc-4f87-a173-f2f2a7acdac1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:25 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d92547-febc-4f87-a173-f2f2a7acdac1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac
Jul 06 13:42:25 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:26 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d92547-febc-4f87-a173-f2f2a7acdac1 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac" returned: 0 in 0.669s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:26 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac is being set with open permissions: ugo+rw
Jul 06 13:42:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:26 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac
Jul 06 13:42:26 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:26 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac" returned: 0 in 0.615s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:26 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:26 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info
Jul 06 13:42:26 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:27 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info" returned: 0 in 0.609s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:27 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info is being set with open permissions: ugo+rw
Jul 06 13:42:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:27 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info
Jul 06 13:42:27 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:27 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:27 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.info" returned: 0 in 0.606s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:28 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.091s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:28 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-fe84f308-b8c4-4176-8b97-ca9540fa3598 tempest-ProjectReaderTests-1875204325 None] Create snapshot completed successfully
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-d6fa6d13-6164-4c38-8689-988cfaa836ac-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-d6fa6d13-6164-4c38-8689-988cfaa836ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-d6fa6d13-6164-4c38-8689-988cfaa836ac" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-d6fa6d13-6164-4c38-8689-988cfaa836ac" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Deleting offline snapshot d6fa6d13-6164-4c38-8689-988cfaa836ac of volume 57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] snapshot_file for this snap is: volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f0827e-fdc7-46c5-8e55-4c0bd3bba0ab]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:29 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac
Jul 06 13:42:29 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:29 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac" returned: 0 in 0.716s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d92547-febc-4f87-a173-f2f2a7acdac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fbc496-94b4-46cf-9845-6375f8d547ea]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:29 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:30 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1
Jul 06 13:42:30 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:30 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1" returned: 0 in 0.731s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:30 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:30 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac
Jul 06 13:42:30 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:31 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac" returned: 0 in 0.730s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:31 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:31 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac
Jul 06 13:42:31 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:32 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1.d6fa6d13-6164-4c38-8689-988cfaa836ac" returned: 0 in 0.627s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-d6fa6d13-6164-4c38-8689-988cfaa836ac" released by "_delete_snapshot" :: held 2.891s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" released by "delete_snapshot" :: held 2.912s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Created reservations ['e9e82962-1f8a-4681-87be-49a43b33fab5', '744806c6-81a4-4ee4-a993-0de5c8124055', '48851459-2178-46b8-8ca1-05a1040ffcb0', 'e3563f5b-8964-43cf-bd02-3f9a06fc91fc'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:32 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Delete snapshot completed successfully.
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-77d58267-a9ac-4258-858c-b94a97ce7c3f tempest-ProjectReaderTests-1875204325 None] Lock "cinder-d6fa6d13-6164-4c38-8689-988cfaa836ac-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-57d92547-febc-4f87-a173-f2f2a7acdac1-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-57d92547-febc-4f87-a173-f2f2a7acdac1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c35f15-29e2-40bc-a109-4a4b0e902669]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:32 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:32 devstack sudo[106360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1
Jul 06 13:42:32 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:33 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:33 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1
Jul 06 13:42:33 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:33 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-57d92547-febc-4f87-a173-f2f2a7acdac1" returned: 0 in 0.613s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-57d92547-febc-4f87-a173-f2f2a7acdac1" released by "delete_volume" :: held 1.398s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Created reservations ['95a15d50-c917-492a-9423-24620f02668d', '5f314ece-5440-42b7-bcc9-d3478ed94428', '80133272-2edb-4168-94b2-33458184c3f9', '95ca60ec-a0f2-41be-8add-aca36feb570c'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:33 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:33 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:33 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:34 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.604s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:42:34 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Deleted volume successfully.
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-154799e3-e0a7-4fae-9ade-b633bb136a11 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-57d92547-febc-4f87-a173-f2f2a7acdac1-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (4bd9c0ad-111a-42ec-9936-8c1c90e4b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190f318d-2218-467c-b167-71c3dbeb515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190f318d-2218-467c-b167-71c3dbeb515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114268451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1275077-1429-49d8-ba3f-c8b1a4a5206e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:35Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:34 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfff4f9-cef7-4d99-acfa-e6d1e5c704a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bfff4f9-cef7-4d99-acfa-e6d1e5c704a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f772e0b-c3e5-4644-a86d-0ecf0b4856c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f772e0b-c3e5-4644-a86d-0ecf0b4856c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1275077-1429-49d8-ba3f-c8b1a4a5206e', 'volume_name': 'volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b774d236-5624-41b9-9d82-b955dfc4ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b774d236-5624-41b9-9d82-b955dfc4ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89719262-7ec7-4853-87b7-323c5898e79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:35 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Volume c1275077-1429-49d8-ba3f-c8b1a4a5206e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e', 'volume_size': 1}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114268451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1275077-1429-49d8-ba3f-c8b1a4a5206e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:35Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Creating volume c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:42:35 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:35 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e 1073741824
Jul 06 13:42:35 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:35 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e 1073741824" returned: 0 in 0.808s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:35 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:35 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e
Jul 06 13:42:35 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:36 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e" returned: 0 in 0.601s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89719262-7ec7-4853-87b7-323c5898e79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f95955e-148c-4f9e-b0a7-f6cc7b14110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:36 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Volume volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e (c1275077-1429-49d8-ba3f-c8b1a4a5206e): created successfully
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f95955e-148c-4f9e-b0a7-f6cc7b14110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:36 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (4bd9c0ad-111a-42ec-9936-8c1c90e4b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:36 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-5d35fa21-05a4-44a0-a7f4-9e9ec842d88a tempest-ProjectReaderTests-1875204325 None] Created volume successfully.
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Creating offline snapshot d6892401-1675-46e1-a3f2-0d92221720cc of volume c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[90115b68-24c3-4688-8f52-1a7159927013]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:37 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e
Jul 06 13:42:37 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:37 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e" returned: 0 in 0.716s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:37 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:37 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc 1G
Jul 06 13:42:37 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:38 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc 1G" returned: 0 in 0.724s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:38 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:38 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc
Jul 06 13:42:38 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:39 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc" returned: 0 in 0.671s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:39 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc is being set with open permissions: ugo+rw
Jul 06 13:42:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:39 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc
Jul 06 13:42:39 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:39 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc" returned: 0 in 0.599s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:39 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:39 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info
Jul 06 13:42:39 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:40 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info" returned: 0 in 0.615s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:40 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info is being set with open permissions: ugo+rw
Jul 06 13:42:40 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:40 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info
Jul 06 13:42:40 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:41 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.info" returned: 0 in 0.628s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.031s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:41 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-8518b6b3-dd4c-4e49-b378-4ab59f579920 tempest-ProjectReaderTests-1875204325 None] Create snapshot completed successfully
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-d6892401-1675-46e1-a3f2-0d92221720cc-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-d6892401-1675-46e1-a3f2-0d92221720cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-d6892401-1675-46e1-a3f2-0d92221720cc" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-d6892401-1675-46e1-a3f2-0d92221720cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Deleting offline snapshot d6892401-1675-46e1-a3f2-0d92221720cc of volume c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] snapshot_file for this snap is: volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc38337-683c-4f73-82d6-88171f65f549]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:41 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:41 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc
Jul 06 13:42:41 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:42 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc" returned: 0 in 0.717s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb915f5-0794-47a4-9a8c-30f6ee887b18]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:42 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e
Jul 06 13:42:42 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:42 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e" returned: 0 in 0.731s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:42 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:42 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc
Jul 06 13:42:42 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:43 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc" returned: 0 in 0.717s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:43 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:43 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc
Jul 06 13:42:43 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:44 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e.d6892401-1675-46e1-a3f2-0d92221720cc" returned: 0 in 0.619s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-d6892401-1675-46e1-a3f2-0d92221720cc" released by "_delete_snapshot" :: held 2.865s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" released by "delete_snapshot" :: held 2.886s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Created reservations ['12ba5a0d-face-4519-9ea8-c5137f563f58', '74a5bee8-55e4-4f86-a843-fb9628ef5029', '60d3a588-caf6-4d12-9d88-26bd4f1e2598', 'a81aaf6c-0800-4024-a652-171b1f5c67ae'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:44 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Delete snapshot completed successfully.
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-500d34ff-767d-4a1d-9c07-b7ed8737229e tempest-ProjectReaderTests-1875204325 None] Lock "cinder-d6892401-1675-46e1-a3f2-0d92221720cc-delete_snapshot" released by "delete_snapshot" :: held 3.011s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-c1275077-1429-49d8-ba3f-c8b1a4a5206e-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-c1275077-1429-49d8-ba3f-c8b1a4a5206e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2ec67-a135-4af2-978c-fcc40a694d2a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:44 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:44 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e
Jul 06 13:42:44 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:45 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e" returned: 0 in 0.750s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:45 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:45 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e
Jul 06 13:42:45 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:46 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-c1275077-1429-49d8-ba3f-c8b1a4a5206e" returned: 0 in 0.626s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-c1275077-1429-49d8-ba3f-c8b1a4a5206e" released by "delete_volume" :: held 1.433s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Created reservations ['d1a84202-495b-416f-b014-a9340147d958', '90232b0e-ba74-46c2-b0ee-9f5b9a2c630d', '881940fe-7c7e-4e78-93d2-122aa7f5dea7', '05e5813a-ec1c-4916-9e5d-4e5d536231fe'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:46 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:46 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:46 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.658s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:42:46 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Deleted volume successfully.
Jul 06 13:42:46 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-95f4957d-e54d-40bf-8ddb-b5083dca3ff6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-c1275077-1429-49d8-ba3f-c8b1a4a5206e-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (0d0f4c1e-b6ed-4a74-8ffb-69d1e999ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f2e989-5eb4-433b-b68a-63b5b772a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f2e989-5eb4-433b-b68a-63b5b772a961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076246643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8525af9-8fd2-48a9-a648-e377abcef883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:47Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b449cb-d3ca-4a27-9b34-2e9c715e5fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b449cb-d3ca-4a27-9b34-2e9c715e5fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29002278-ee11-4351-a58d-347898431e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29002278-ee11-4351-a58d-347898431e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8525af9-8fd2-48a9-a648-e377abcef883', 'volume_name': 'volume-e8525af9-8fd2-48a9-a648-e377abcef883', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321168-7367-455f-a897-725e9e89ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78321168-7367-455f-a897-725e9e89ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cce61f9-f8e2-4019-aca7-20ec374c83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:47 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Volume e8525af9-8fd2-48a9-a648-e377abcef883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8525af9-8fd2-48a9-a648-e377abcef883', 'volume_size': 1}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2076246643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8525af9-8fd2-48a9-a648-e377abcef883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:42:47Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Creating volume e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:42:47 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:42:47 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:47 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 1073741824
Jul 06 13:42:47 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:48 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 1073741824" returned: 0 in 0.835s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:48 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883
Jul 06 13:42:48 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:48 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883" returned: 0 in 0.618s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cce61f9-f8e2-4019-aca7-20ec374c83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8525af9-8fd2-48a9-a648-e377abcef883', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950588b5-6abd-4d32-9f73-214e23205a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:INSERT=27,cinder:UPDATE=97,cinder:SELECT=66,cinder:DELETE=6 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:42:48 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Volume volume-e8525af9-8fd2-48a9-a648-e377abcef883 (e8525af9-8fd2-48a9-a648-e377abcef883): created successfully
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (950588b5-6abd-4d32-9f73-214e23205a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:42:48 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (0d0f4c1e-b6ed-4a74-8ffb-69d1e999ba30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:42:48 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a72b4f21-1298-42f8-932d-735db34b5eaf tempest-ProjectReaderTests-1875204325 None] Created volume successfully.
Jul 06 13:42:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:49 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Creating offline snapshot a84c069b-29ab-4b58-89b9-de0be54fb5dd of volume e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:42:49 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa96a2f-c793-4fe6-ba10-06ffada0031e]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:49 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:49 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883
Jul 06 13:42:49 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:50 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883" returned: 0 in 0.739s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:50 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:50 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd 1G
Jul 06 13:42:50 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:51 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd 1G" returned: 0 in 0.884s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8525af9-8fd2-48a9-a648-e377abcef883 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:51 devstack sudo[106455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8525af9-8fd2-48a9-a648-e377abcef883 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd
Jul 06 13:42:51 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:51 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8525af9-8fd2-48a9-a648-e377abcef883 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd" returned: 0 in 0.710s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:51 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd is being set with open permissions: ugo+rw
Jul 06 13:42:51 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:51 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd
Jul 06 13:42:51 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:52 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd" returned: 0 in 0.634s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:52 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=62,cinder:UPDATE=75,cinder:DELETE=8,cinder:INSERT=20 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:42:52 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:52 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info
Jul 06 13:42:52 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:53 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info" returned: 0 in 0.717s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:53 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info is being set with open permissions: ugo+rw
Jul 06 13:42:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:53 devstack sudo[106466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info
Jul 06 13:42:53 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:53 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.info" returned: 0 in 0.641s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:53 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.426s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:53 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-e0f05de8-a904-45d9-974f-83d1b28bb84d tempest-ProjectReaderTests-1875204325 None] Create snapshot completed successfully
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-a84c069b-29ab-4b58-89b9-de0be54fb5dd-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-a84c069b-29ab-4b58-89b9-de0be54fb5dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-a84c069b-29ab-4b58-89b9-de0be54fb5dd" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-a84c069b-29ab-4b58-89b9-de0be54fb5dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Deleting offline snapshot a84c069b-29ab-4b58-89b9-de0be54fb5dd of volume e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] snapshot_file for this snap is: volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e43be6-1aa7-4410-8618-1743c3127aa2]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:54 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:54 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd
Jul 06 13:42:54 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:55 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd" returned: 0 in 0.734s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:55 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8525af9-8fd2-48a9-a648-e377abcef883(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:42:55 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[df501e7d-920c-45b4-bf85-4c60e8fb7d4d]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:55 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:55 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883
Jul 06 13:42:55 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:56 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883" returned: 0 in 0.728s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:56 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:56 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd
Jul 06 13:42:56 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:57 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd" returned: 0 in 0.726s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:57 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd
Jul 06 13:42:57 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:57 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883.a84c069b-29ab-4b58-89b9-de0be54fb5dd" returned: 0 in 0.687s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-a84c069b-29ab-4b58-89b9-de0be54fb5dd" released by "_delete_snapshot" :: held 2.968s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" released by "delete_snapshot" :: held 2.995s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Created reservations ['15a5807c-2cb1-4610-b072-4f2f12edec37', '6ad87e07-ae29-46c6-a824-49b08b64cc2b', '33812707-0cb1-4217-a737-8590200e3f66', '51cf1d68-44a8-4204-8f27-8885a5ec6e3e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:57 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Delete snapshot completed successfully.
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-ffd734ee-bc68-4348-bfd8-9e064787b1e6 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-a84c069b-29ab-4b58-89b9-de0be54fb5dd-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-e8525af9-8fd2-48a9-a648-e377abcef883-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-e8525af9-8fd2-48a9-a648-e377abcef883-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:42:57 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" acquired by "delete_volume" :: waited 0.014s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:42:58 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1366121-0bf9-4ef7-9007-813cfdc7d6b7]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:42:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:58 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883
Jul 06 13:42:58 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:58 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883" returned: 0 in 0.733s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:58 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:58 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883
Jul 06 13:42:58 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:42:59 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-e8525af9-8fd2-48a9-a648-e377abcef883" returned: 0 in 0.602s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-e8525af9-8fd2-48a9-a648-e377abcef883" released by "delete_volume" :: held 1.394s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Created reservations ['fed97df0-a076-4893-bd61-3fd7a2a1a84b', 'bfeac69f-a529-43d4-ab26-65709f0417ff', '612beb51-001f-400b-bb51-300f3fcb6756', '6033d9f2-228c-4db6-bf31-60a2b878494e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:42:59 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:42:59 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:42:59 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:00 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.639s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:43:00 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Deleted volume successfully.
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-7130a183-6e4f-47f6-8697-98d4feaaf447 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-e8525af9-8fd2-48a9-a648-e377abcef883-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86698) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (4332b27e-edc4-4ba2-85d5-5d1678bafb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e8296-a0c0-4cc9-9247-7f53cc1810ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84e8296-a0c0-4cc9-9247-7f53cc1810ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331238057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ce238e-d313-47ba-b487-51fbfee73730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:43:01Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd26072-0f4e-4c13-b224-dfcbc2885a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cd26072-0f4e-4c13-b224-dfcbc2885a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f31835-b241-4bdb-9c8d-033ddb720686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f31835-b241-4bdb-9c8d-033ddb720686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ce238e-d313-47ba-b487-51fbfee73730', 'volume_name': 'volume-45ce238e-d313-47ba-b487-51fbfee73730', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa48a52b-08ea-4620-8083-53259973b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa48a52b-08ea-4620-8083-53259973b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eec043-3db2-4dc7-97df-22294fec2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:00 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Volume 45ce238e-d313-47ba-b487-51fbfee73730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ce238e-d313-47ba-b487-51fbfee73730', 'volume_size': 1}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72359a0ebfe0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T11:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-331238057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ce238e-d313-47ba-b487-51fbfee73730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='219c64f6b52b496ca0696fc45f7a8879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T11:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T11:43:01Z,use_quota=True,user_id='bc5ea45dd0a6470f966a5ba41b131656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3931fcd1-0494-47f5-848c-c1b98981f1b2),volume_type_id=3931fcd1-0494-47f5-848c-c1b98981f1b2)}" {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Creating volume 45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Selected osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794 as target Quobyte volume. {{(pid=86698) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 13:43:00 devstack cinder-volume[86698]: INFO cinder.volume.drivers.remotefs [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] casted to osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794
Jul 06 13:43:00 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 1073741824 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:00 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 1073741824
Jul 06 13:43:00 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:01 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 1073741824" returned: 0 in 0.794s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:01 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:01 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730
Jul 06 13:43:01 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:02 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730" returned: 0 in 0.666s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'} {{(pid=86698) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6eec043-3db2-4dc7-97df-22294fec2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ce238e-d313-47ba-b487-51fbfee73730', 'volume_size': 1}' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273f0ec2-7f44-404a-a1a4-a771ac86885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 13:43:02 devstack cinder-volume[86698]: INFO cinder.volume.flows.manager.create_volume [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Volume volume-45ce238e-d313-47ba-b487-51fbfee73730 (45ce238e-d313-47ba-b487-51fbfee73730): created successfully
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (273f0ec2-7f44-404a-a1a4-a771ac86885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86698) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Flow 'volume_create_manager' (4332b27e-edc4-4ba2-85d5-5d1678bafb50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86698) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 13:43:02 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-7e411ac2-410d-4246-b381-c8b840b90918 tempest-ProjectReaderTests-1875204325 None] Created volume successfully.
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Creating offline snapshot cc954b69-d6a8-4332-a663-e2e67038d9d0 of volume 45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[12150a16-5281-458f-8966-79d2aecc152a]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:43:02 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:02 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730
Jul 06 13:43:02 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:03 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730" returned: 0 in 0.755s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:03 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 1G {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:03 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 1G
Jul 06 13:43:03 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:04 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 1G" returned: 0 in 0.782s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:04 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ce238e-d313-47ba-b487-51fbfee73730 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:04 devstack sudo[106519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ce238e-d313-47ba-b487-51fbfee73730 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0
Jul 06 13:43:04 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:05 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45ce238e-d313-47ba-b487-51fbfee73730 -F qcow2 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0" returned: 0 in 0.665s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:05 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 is being set with open permissions: ugo+rw
Jul 06 13:43:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:05 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0
Jul 06 13:43:05 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:05 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0" returned: 0 in 0.634s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:05 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:05 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info
Jul 06 13:43:05 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:06 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info" returned: 0 in 0.712s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:06 devstack cinder-volume[86698]: WARNING cinder.volume.drivers.remotefs [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info is being set with open permissions: ugo+rw
Jul 06 13:43:06 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:06 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info
Jul 06 13:43:06 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:07 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.info" returned: 0 in 0.620s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:07 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.249s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:43:07 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-28373c7b-2e15-41fe-b63a-fc9b7ba49942 tempest-ProjectReaderTests-1875204325 None] Create snapshot completed successfully
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-cc954b69-d6a8-4332-a663-e2e67038d9d0-delete_snapshot" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-cc954b69-d6a8-4332-a663-e2e67038d9d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" by "delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-cc954b69-d6a8-4332-a663-e2e67038d9d0" by "_delete_snapshot" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-cc954b69-d6a8-4332-a663-e2e67038d9d0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Deleting offline snapshot cc954b69-d6a8-4332-a663-e2e67038d9d0 of volume 45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] snapshot_file for this snap is: volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe4b05-de46-490b-a90f-77c4ccef36dc]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:08 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0
Jul 06 13:43:08 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:08 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0" returned: 0 in 0.697s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.remotefs [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45ce238e-d313-47ba-b487-51fbfee73730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86698) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5794dbc-e36e-4799-af17-5b8c39a9e394]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:43:08 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:08 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730
Jul 06 13:43:08 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:09 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730" returned: 0 in 0.709s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:09 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:09 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0
Jul 06 13:43:09 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:10 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0" returned: 0 in 0.674s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:10 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0
Jul 06 13:43:10 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:10 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730.cc954b69-d6a8-4332-a663-e2e67038d9d0" returned: 0 in 0.609s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-cc954b69-d6a8-4332-a663-e2e67038d9d0" released by "_delete_snapshot" :: held 2.771s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" released by "delete_snapshot" :: held 2.793s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Created reservations ['caed4b32-b3b4-4e40-9e6d-59973f33708a', '2aeab49c-59e6-4758-909f-e055f8ed9551', '0976b386-88b5-4d30-bf74-55255ae7228f', 'ca5a6851-d9eb-4238-b180-54f421ef160a'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:43:10 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Delete snapshot completed successfully.
Jul 06 13:43:10 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-1524dd70-b6b0-4e8b-82cf-d27096f39a06 tempest-ProjectReaderTests-1875204325 None] Lock "cinder-cc954b69-d6a8-4332-a663-e2e67038d9d0-delete_snapshot" released by "delete_snapshot" :: held 2.922s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-45ce238e-d313-47ba-b487-51fbfee73730-delete_volume" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "cinder-45ce238e-d313-47ba-b487-51fbfee73730-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Acquiring lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" by "delete_volume" {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" acquired by "delete_volume" :: waited 0.017s {{(pid=86698) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b07b3-fe41-46c5-949e-d54fa0897e76]: (4, 'qcow2') {{(pid=87595) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 13:43:11 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:11 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730
Jul 06 13:43:11 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:12 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730" returned: 0 in 0.708s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730 {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:12 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730
Jul 06 13:43:12 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:12 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b/volume-45ce238e-d313-47ba-b487-51fbfee73730" returned: 0 in 0.629s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "cinder-quobyte-45ce238e-d313-47ba-b487-51fbfee73730" released by "delete_volume" :: held 1.409s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG cinder.quota [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Created reservations ['4b0584c1-3949-4bff-8aa2-bd3294bdbb7e', 'e9f68d23-bf2c-4640-8609-82e9499c16eb', '8f15b375-5da0-419e-89e4-c1ba850bc760', '4c540314-2955-42c6-af79-d3e594cde61e'] {{(pid=86698) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:43:12 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:12 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:43:12 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:13 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:13 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.630s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:13 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:43:13 devstack cinder-volume[86698]: INFO cinder.volume.manager [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Deleted volume successfully.
Jul 06 13:43:13 devstack cinder-volume[86698]: DEBUG cinder.coordination [None req-a7d47a16-6d03-46e6-b539-1f46751323fc tempest-ProjectReaderTests-1875204325 None] Lock "cinder-45ce238e-d313-47ba-b487-51fbfee73730-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=86698) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794': None} {{(pid=86698) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-53d580ee-2204-4194-a9bc-93951f511794'] {{(pid=86698) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.lockutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86698) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 13:43:18 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 13:43:18 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b
Jul 06 13:43:18 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 13:43:19 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Jul 06 13:43:19 devstack cinder-volume[86698]: DEBUG oslo_concurrency.processutils [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a308b7fd9b8ce06cab2f94493de2a64b" returned: 0 in 0.621s {{(pid=86698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 13:43:19 devstack cinder-volume[86698]: DEBUG cinder.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Notifying Schedulers of capabilities ... {{(pid=86698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 13:43:19 devstack cinder-volume[86698]: DEBUG oslo_service.periodic_task [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] Running periodic task VolumeManager._thread_info {{(pid=86698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 13:43:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread count: 28 {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 13:43:19 devstack cinder-volume[86698]: DEBUG cinder.volume.manager [None req-4d2a0dfe-e82b-488d-92a2-4406e3897f57 None None] thread info: [<_MainThread(MainThread, started 125574652641408)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 125574543361728)>, <Thread(Thread-3 (stat_writer), started daemon 125574544712768)>, <Thread(Rabbit-heartbeat, started daemon 125574541365760)>, <Thread(Thread-5 (_runner), started daemon 125574539257344)>, <Thread(Thread-7 (_runner), started daemon 125574539317696)>, <Thread(fd_logger, started daemon 125574536981056)>, <Thread(privsep_reader, started daemon 125574537027328)>, <Thread(tpool_thread_0, started daemon 125574527276736)>, <Thread(tpool_thread_1, started daemon 125574518884032)>, <Thread(tpool_thread_2, started daemon 125574510491328)>, <Thread(tpool_thread_3, started daemon 125574502082240)>, <Thread(tpool_thread_4, started daemon 125574493673152)>, <Thread(tpool_thread_5, started daemon 125574485264064)>, <Thread(tpool_thread_6, started daemon 125574476854976)>, <Thread(tpool_thread_7, started daemon 125574468445888)>, <Thread(tpool_thread_8, started daemon 125574460036800)>, <Thread(tpool_thread_9, started daemon 125574451627712)>, <Thread(tpool_thread_10, started daemon 125574443218624)>, <Thread(tpool_thread_11, started daemon 125574434809536)>, <Thread(tpool_thread_12, started daemon 125574426400448)>, <Thread(tpool_thread_13, started daemon 125574417991360)>, <Thread(tpool_thread_14, started daemon 125574409582272)>, <Thread(tpool_thread_15, started daemon 125574401173184)>, <Thread(tpool_thread_16, started daemon 125574392764096)>, <Thread(tpool_thread_17, started daemon 125574384355008)>, <Thread(tpool_thread_18, started daemon 125574375945920)>, <Thread(tpool_thread_19, started daemon 125574367536832)>] {{(pid=86698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 13:43:22 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:UPDATE=34,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 13:43:23 devstack cinder-volume[86698]: DEBUG dbcounter [-] [86698] Writing DB stats cinder:SELECT=32,cinder:INSERT=11,cinder:DELETE=3,cinder:UPDATE=31 {{(pid=86698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}